Jul 08 00:07:50.663456 ip-10-0-128-26 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 00:07:50.663468 ip-10-0-128-26 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 00:07:50.663475 ip-10-0-128-26 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 00:07:50.663710 ip-10-0-128-26 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 00:08:00.729179 ip-10-0-128-26 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 00:08:00.729192 ip-10-0-128-26 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 20fb51fcf4db4a12aa132e5306c41794 -- Jul 08 00:09:56.174355 ip-10-0-128-26 systemd[1]: Starting Kubernetes Kubelet... Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.580149 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.584991 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585003 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585007 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585011 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585014 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585017 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585021 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 00:09:56.641429 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585024 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585027 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585030 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585032 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585035 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585037 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585040 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585043 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585047 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585050 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585053 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585075 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585080 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585083 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585085 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585088 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585091 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585094 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585097 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585099 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 00:09:56.643906 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585103 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585106 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585108 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585111 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585114 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585117 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585120 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585123 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585127 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585131 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585135 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585138 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585140 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585143 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585145 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585149 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585153 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585156 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585159 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 00:09:56.644640 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585162 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585165 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585168 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585171 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585174 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585177 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585180 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585182 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585185 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585187 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585191 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585193 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585196 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585199 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585202 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585205 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585207 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585210 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585213 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585216 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 00:09:57.944391 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585219 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 00:09:56.664734 ip-10-0-128-26 systemd[1]: Started Kubernetes Kubelet. Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585221 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585224 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585226 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585229 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585232 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585234 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585236 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585241 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585244 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585246 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585249 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585251 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585254 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585256 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585259 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585261 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585264 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585266 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585269 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 00:09:57.945431 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585271 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585274 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585276 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585279 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585282 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585285 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585289 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585292 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585295 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585298 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585301 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585304 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.585307 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586058 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586085 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586089 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586092 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586096 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586099 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 00:09:57.946164 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586102 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586105 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586108 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586111 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586114 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586116 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586119 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586122 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586124 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586127 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586130 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586133 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586136 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586138 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586141 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586144 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586147 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586150 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586152 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 00:09:57.946815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586155 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586158 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586161 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586163 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586166 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586168 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586171 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586173 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586176 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586178 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586181 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586183 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586187 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586190 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586192 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586195 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586198 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586200 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586203 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586208 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 00:09:57.947791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586210 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586213 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586217 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586221 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586224 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586227 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586230 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586233 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586236 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586239 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586242 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586244 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586247 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586250 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586252 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586255 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586258 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586260 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586263 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586265 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 00:09:57.950448 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586268 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586270 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586273 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586275 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586278 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586281 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586284 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586287 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586290 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586292 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586295 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586299 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586301 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586304 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586306 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586309 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586311 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586315 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586318 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 00:09:57.951018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586321 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586323 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586326 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586328 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586331 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586336 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586339 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586351 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586355 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586359 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586363 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586367 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586371 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586375 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586379 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586911 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586917 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586921 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586925 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 00:09:57.951642 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586931 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586937 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586941 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586945 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586949 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586956 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586960 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586963 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586967 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586972 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586977 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586981 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586984 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586988 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586992 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.586996 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587000 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587004 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587008 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587011 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 00:09:57.952262 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587015 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587019 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587022 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587027 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587033 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587037 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587039 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587043 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587048 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587052 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587056 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587060 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587079 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587083 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587087 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587091 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587095 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587101 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587104 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 00:09:57.952879 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587108 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587112 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587117 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587120 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587125 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587128 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587132 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587136 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587139 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587143 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587147 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587150 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587154 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587158 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587161 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587164 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587168 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587172 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587180 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587184 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587188 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 00:09:57.953504 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587192 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587196 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587199 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587203 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587207 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587211 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587214 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587218 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587222 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587228 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587232 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587235 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587239 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587244 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587248 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587252 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587256 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587260 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587264 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 00:09:57.954329 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587267 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587271 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587275 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587279 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587283 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587286 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587290 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587293 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587298 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587301 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587305 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587308 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587313 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587316 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587320 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.587323 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587411 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587421 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587430 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587437 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 00:09:57.954838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587443 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587448 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587456 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587463 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587467 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587470 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587477 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587481 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587486 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587491 2573 flags.go:64] FLAG: --cgroup-root="" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587494 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587499 2573 flags.go:64] FLAG: --client-ca-file="" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587504 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587508 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587514 2573 flags.go:64] FLAG: --cluster-domain="" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587518 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587523 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587527 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587532 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587537 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587542 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587546 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587551 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587556 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 08 00:09:57.955440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587560 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587565 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587569 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587573 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587579 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587583 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587588 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587592 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587597 2573 flags.go:64] FLAG: --enable-server="true" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587601 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587610 2573 flags.go:64] FLAG: --event-burst="100" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587614 2573 flags.go:64] FLAG: --event-qps="50" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587619 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587623 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587629 2573 flags.go:64] FLAG: --eviction-hard="" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587634 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587638 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587642 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587647 2573 flags.go:64] FLAG: --eviction-soft="" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587651 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587655 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587659 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587664 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587668 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587672 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 00:09:57.956083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587675 2573 flags.go:64] FLAG: --feature-gates="" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587685 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587690 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587694 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587699 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587703 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587707 2573 flags.go:64] FLAG: --help="false" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587711 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-128-26.ec2.internal" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587716 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587721 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587725 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587730 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587734 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587738 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587742 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587747 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587751 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587758 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587762 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587767 2573 flags.go:64] FLAG: --kube-reserved="" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587771 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587776 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587781 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587785 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 00:09:57.956795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587789 2573 flags.go:64] FLAG: --lock-file="" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587793 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587797 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587802 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587809 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587813 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587817 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587821 2573 flags.go:64] FLAG: --logging-format="text" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587825 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587830 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587833 2573 flags.go:64] FLAG: --manifest-url="" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587837 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587843 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587847 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587853 2573 flags.go:64] FLAG: --max-pods="110" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587857 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587861 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587865 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587869 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587874 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587878 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587881 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587888 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587892 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587897 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 00:09:57.957433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587903 2573 flags.go:64] FLAG: --pod-cidr="" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587907 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587915 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587919 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587924 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587930 2573 flags.go:64] FLAG: --port="10250" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587934 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587938 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04fd55c2cd67fe4f8" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587944 2573 flags.go:64] FLAG: --qos-reserved="" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587948 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587952 2573 flags.go:64] FLAG: --register-node="true" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587956 2573 flags.go:64] FLAG: --register-with-taints="" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587961 2573 flags.go:64] FLAG: --registry-burst="10" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587966 2573 flags.go:64] FLAG: --registry-qps="5" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587970 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587973 2573 flags.go:64] FLAG: --reserved-memory="" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587979 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587983 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587987 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587992 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.587996 2573 flags.go:64] FLAG: --runonce="false" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588000 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588004 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588009 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588013 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 00:09:57.958170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588017 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588021 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588025 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588029 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588033 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588037 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588041 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588046 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588052 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588055 2573 flags.go:64] FLAG: --system-cgroups="" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588060 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588083 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588088 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588092 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588098 2573 flags.go:64] FLAG: --tls-min-version="" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588102 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588107 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588110 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588115 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588119 2573 flags.go:64] FLAG: --v="2" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588125 2573 flags.go:64] FLAG: --version="false" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588131 2573 flags.go:64] FLAG: --vmodule="" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588136 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.588141 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588297 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 00:09:57.958817 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588302 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588305 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588308 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588310 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588313 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588315 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588318 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588321 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588323 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588326 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588328 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588331 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588335 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588338 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588342 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588345 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588349 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588351 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588354 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 00:09:57.959728 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588360 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588362 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588365 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588367 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588371 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588373 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588376 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588378 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588381 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588383 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588386 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588388 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588391 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588394 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588396 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588399 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588401 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588404 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588406 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588409 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 00:09:57.960777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588411 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588414 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588416 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588419 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588421 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588424 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588426 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588430 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588433 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588435 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588438 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588441 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588445 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588447 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588450 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588452 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588455 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588458 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588460 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588464 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 00:09:57.961416 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588467 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588470 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588473 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588476 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588479 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588482 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588484 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588487 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588490 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588492 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588495 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588497 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588500 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588502 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588505 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588507 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588510 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588513 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588515 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588519 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 00:09:57.962110 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588522 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588525 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588527 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588530 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588534 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588536 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588539 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588541 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588544 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588546 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588549 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588551 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588554 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588557 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588561 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588564 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588567 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588570 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 00:09:57.962791 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.588573 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.589347 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.598140 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.598158 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.598822 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.598830 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598889 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598894 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598897 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598901 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598904 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598909 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598912 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598915 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 00:09:57.965998 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598918 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598921 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598924 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598927 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598930 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598934 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598937 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598940 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598943 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598946 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598948 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598951 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598953 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598956 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598958 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598962 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598965 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598968 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598971 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598973 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 00:09:57.966617 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598977 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598979 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598982 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598984 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598987 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598991 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598995 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.598998 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599000 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599004 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599006 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599009 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599011 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599014 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599017 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599019 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599022 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599025 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599027 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 00:09:58.069237 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599030 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599033 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599035 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599038 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599040 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599043 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599046 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599048 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599052 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599054 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599057 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599060 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599080 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599083 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599086 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599089 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599091 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599094 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599097 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599099 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 00:09:58.086868 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599102 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599104 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599107 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599109 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599112 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599114 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599117 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599119 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599122 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599124 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599127 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599129 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599133 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599135 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599138 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599140 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599143 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599145 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599148 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599151 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 00:09:58.087635 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599155 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599157 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599161 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599163 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599171 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599175 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599177 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599180 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599183 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599186 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599189 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599191 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.599197 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599316 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599321 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 00:09:58.088279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599324 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599328 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599331 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599334 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599337 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599340 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599343 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599345 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599348 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599351 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599354 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599356 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599359 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599361 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599364 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599366 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599369 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599374 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599376 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599379 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 00:09:58.088820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599382 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599384 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599388 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599391 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599394 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599396 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599398 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599401 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599404 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599406 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599409 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599411 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599414 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599417 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599419 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599422 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599424 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599427 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599429 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599432 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 00:09:58.089927 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599434 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599436 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599439 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599442 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599445 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599448 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599450 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599452 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599456 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599462 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599464 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599467 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599470 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599473 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599477 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599480 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599482 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599485 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599488 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599490 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 00:09:58.090598 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599493 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599496 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599498 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599501 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599505 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599509 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599512 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599515 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599518 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599521 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599524 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599528 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599530 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599533 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599536 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599539 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599542 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599545 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599548 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 00:09:58.091211 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599550 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599553 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599557 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599559 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599562 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599564 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599567 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599571 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599573 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599576 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599578 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599581 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599584 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599586 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599589 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599591 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599594 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 00:09:58.091846 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:56.599597 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.599601 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.599707 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.603420 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.605028 2573 server.go:1019] "Starting client certificate rotation" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.605095 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.605127 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.608675 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.611641 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.630684 2573 log.go:25] "Validated CRI v1 runtime API" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.633052 2573 log.go:25] "Validated CRI v1 image API" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.634769 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 00:09:58.092416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.638633 2573 fs.go:135] Filesystem UUIDs: map[14a2b9b9-69b2-4c1b-9c53-38b6a280b13c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a4a9367a-0ee1-4d97-8a90-9684905309cc:/dev/nvme0n1p3] Jul 08 00:09:58.092807 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.638649 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 00:09:58.092807 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.639821 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.645085 2573 manager.go:216] Machine: {Timestamp:2026-07-08 00:09:56.644552765 +0000 UTC m=+0.356430155 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099568 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ec12adcb5179fff99ac783ccd4e0 SystemUUID:ec28ec12-adcb-5179-fff9-9ac783ccd4e0 BootID:20fb51fc-f4db-4a12-aa13-2e5306c41794 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e7:1a:11:3d:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e7:1a:11:3d:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:40:9c:bf:a0:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.645175 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.645254 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.646339 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.646367 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-26.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.647123 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.647132 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.647140 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.647740 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.649055 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.651843 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.651959 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.651986 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.651996 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.652009 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.652019 2573 kubelet.go:398] "Adding apiserver pod source" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.652029 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 00:09:58.093174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.652468 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.652483 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.656780 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.658820 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.658847 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.659959 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.659981 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.659992 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660002 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660012 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660022 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660034 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660042 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660049 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660054 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660085 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660091 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:56.660445 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:56.660457 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660752 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.660760 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.662798 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-26.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.663938 2573 server.go:1268] "Started kubelet" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.663982 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.664303 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.664487 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.666116 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.666220 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:56.670340 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.673039 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.673654 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:56.673795 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.674414 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.675496 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.675511 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.675611 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.675620 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.675720 2573 factory.go:55] Registering systemd factory Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.675735 2573 factory.go:223] Registration of the systemd container factory successfully Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.676013 2573 factory.go:153] Registering CRI-O factory Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.676025 2573 factory.go:223] Registration of the crio container factory successfully Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.676091 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.676113 2573 factory.go:103] Registering Raw factory Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.676127 2573 manager.go:1196] Started watching for new ooms in manager Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.676668 2573 manager.go:349] Starting recovery of all containers Jul 08 00:09:58.093795 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:56.678253 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-26.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:56.678176 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-26.ec2.internal.18c027f78feeb2fa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-26.ec2.internal,UID:ip-10-0-128-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-26.ec2.internal,},FirstTimestamp:2026-07-08 00:09:56.663907066 +0000 UTC m=+0.375784391,LastTimestamp:2026-07-08 00:09:56.663907066 +0000 UTC m=+0.375784391,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-26.ec2.internal,}" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:56.682466 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.687469 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.691854 2573 manager.go:354] Recovery completed Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.692778 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wshrh" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.696023 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:56.699229 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wshrh" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.935189 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.935214 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.935224 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.935761 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.935770 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.935784 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.935809 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.936537 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.936568 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.936581 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.937224 2573 policy_none.go:49] "None policy: Start" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.937238 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.937248 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:57.937654 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-26.ec2.internal.18c027f7dbb5132c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-26.ec2.internal,UID:ip-10-0-128-26.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-26.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-26.ec2.internal,},FirstTimestamp:2026-07-08 00:09:57.93519902 +0000 UTC m=+0.414044264,LastTimestamp:2026-07-08 00:09:57.93519902 +0000 UTC m=+0.414044264,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-26.ec2.internal,}" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:57.938229 2573 policy_none.go:47] "Start" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.010570 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.011342 2573 manager.go:337] "Starting Device Plugin manager" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.011370 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.011390 2573 server.go:87] "Starting device plugin registration server" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.011656 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.011669 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.011742 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.011810 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.011816 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.012392 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.012434 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.183069 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.109145 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.109180 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.109201 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.109236 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.111437 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.111744 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.115179 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-26.ec2.internal\" not found" node="ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.117973 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.117998 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.118008 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.118030 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.126433 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.126452 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-26.ec2.internal\": node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.185043 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.147762 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.209975 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal"] Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.210045 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.211650 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.211681 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.211695 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.213089 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.213224 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.213250 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.213854 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.213876 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.213888 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.213913 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.213931 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.213941 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.215169 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.215193 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.215816 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientMemory" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.215836 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.215851 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeHasSufficientPID" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.247821 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-26.ec2.internal\" not found" node="ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.248448 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.301254 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.252086 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-26.ec2.internal\" not found" node="ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.312406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cae3497b7c0be2b9978bb06dee01133d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-26.ec2.internal\" (UID: \"cae3497b7c0be2b9978bb06dee01133d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.312434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2fad8567541d0738f8f57964a81b966-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal\" (UID: \"d2fad8567541d0738f8f57964a81b966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.312452 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2fad8567541d0738f8f57964a81b966-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal\" (UID: \"d2fad8567541d0738f8f57964a81b966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.348630 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.413080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2fad8567541d0738f8f57964a81b966-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal\" (UID: \"d2fad8567541d0738f8f57964a81b966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.413132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2fad8567541d0738f8f57964a81b966-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal\" (UID: \"d2fad8567541d0738f8f57964a81b966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.413172 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cae3497b7c0be2b9978bb06dee01133d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-26.ec2.internal\" (UID: \"cae3497b7c0be2b9978bb06dee01133d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.413177 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2fad8567541d0738f8f57964a81b966-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal\" (UID: \"d2fad8567541d0738f8f57964a81b966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.413195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2fad8567541d0738f8f57964a81b966-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal\" (UID: \"d2fad8567541d0738f8f57964a81b966\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.413228 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cae3497b7c0be2b9978bb06dee01133d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-26.ec2.internal\" (UID: \"cae3497b7c0be2b9978bb06dee01133d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.452452 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.449209 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.563542 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.549780 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.563542 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.550858 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.563542 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.556068 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.757920 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.650273 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.757920 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.750819 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.869934 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.837318 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 00:09:58.869934 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.837483 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 00:09:58.869934 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.851591 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-26.ec2.internal\" not found" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.873063 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.885218 2573 apiserver.go:52] "Watching apiserver" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.890670 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.897524 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.898167 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-5lqlk","openshift-cluster-node-tuning-operator/tuned-m4krb","openshift-multus/multus-nr874","openshift-network-diagnostics/network-check-target-rztbr","openshift-ovn-kubernetes/ovnkube-node-zqqsq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9","openshift-dns/node-resolver-5csdk","openshift-image-registry/node-ca-kmm5f","openshift-multus/multus-additional-cni-plugins-qmx4w","openshift-multus/network-metrics-daemon-qv87q","openshift-network-operator/iptables-alerter-7qsvm","kube-system/global-pull-secret-syncer-gxr69"] Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.899858 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.901313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.902624 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hzvsm\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.902645 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nr874" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.902849 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.903071 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.906860 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.906915 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.907561 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.908805 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.909318 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.909730 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f5dmj\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.909771 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.909841 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.910233 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.910721 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.911635 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.911639 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wpkdg\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.911640 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.912165 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.913303 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.913872 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gl9rh\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.913999 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.914121 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.914289 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.914418 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.914535 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.914648 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.914939 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 00:09:58.966021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.915059 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r8fqv\"" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.915259 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.915389 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.915605 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.915728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.916393 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.916694 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917138 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-js7sz\"" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7c967a8-ef14-4b67-9bef-180b8e5a51bd-agent-certs\") pod \"konnectivity-agent-5lqlk\" (UID: \"f7c967a8-ef14-4b67-9bef-180b8e5a51bd\") " pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917335 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-modprobe-d\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-sysconfig\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-multus-conf-dir\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-multus-socket-dir-parent\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917394 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-run-openvswitch\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917417 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b32cce8-a1c1-44b0-8b28-510526961c3e-env-overrides\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-tuned\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917452 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-var-lib-kubelet\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-slash\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-os-release\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-run-k8s-cni-cncf-io\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-var-lib-cni-multus\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.968139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-kubelet\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-sysctl-d\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f90dbc64-7174-4b0f-ba61-b058c96ae570-tmp\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9wfz\" (UniqueName: \"kubernetes.io/projected/f90dbc64-7174-4b0f-ba61-b058c96ae570-kube-api-access-r9wfz\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917599 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-var-lib-cni-bin\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b32cce8-a1c1-44b0-8b28-510526961c3e-ovn-node-metrics-cert\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-systemd\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917648 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-system-cni-dir\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-run-netns\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917675 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-run-netns\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917696 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917723 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-cni-bin\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-sys\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917755 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-etc-kubernetes\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917769 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-run-ovn\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.970665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917803 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b32cce8-a1c1-44b0-8b28-510526961c3e-ovnkube-config\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7z62\" (UniqueName: \"kubernetes.io/projected/5b32cce8-a1c1-44b0-8b28-510526961c3e-kube-api-access-v7z62\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-kubernetes\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-lib-modules\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-run-systemd\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917916 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-var-lib-openvswitch\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917930 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-etc-openvswitch\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917944 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-run\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-hostroot\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c35106c-2c9b-4a81-b03f-801508924c93-multus-daemon-config\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.917996 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-log-socket\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-host\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-run-multus-certs\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918042 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-256mm\" (UniqueName: \"kubernetes.io/projected/8c35106c-2c9b-4a81-b03f-801508924c93-kube-api-access-256mm\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918057 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-systemd-units\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918077 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7c967a8-ef14-4b67-9bef-180b8e5a51bd-konnectivity-ca\") pod \"konnectivity-agent-5lqlk\" (UID: \"f7c967a8-ef14-4b67-9bef-180b8e5a51bd\") " pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:09:58.971967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-multus-cni-dir\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918129 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c35106c-2c9b-4a81-b03f-801508924c93-cni-binary-copy\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-sysctl-conf\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-node-log\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918182 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-var-lib-kubelet\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-cnibin\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-cni-netd\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918245 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b32cce8-a1c1-44b0-8b28-510526961c3e-ovnkube-script-lib\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918810 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.918933 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919045 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919302 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mv9pd\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919480 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919571 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gzkjw\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919687 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.919732 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919765 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919687 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal"] Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919812 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919818 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919814 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.919967 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:58.919980 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.921983 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.922250 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s9jd6\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.922269 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 00:09:59.051041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.922484 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.922581 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.934284 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 00:04:57 +0000 UTC" deadline="2027-12-26 15:59:28.313594555 +0000 UTC" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.934308 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12879h49m29.37928867s" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.934479 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:58.934744 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal"] Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.008713 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019169 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-kubernetes\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-system-cni-dir\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-os-release\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5hrh\" (UniqueName: \"kubernetes.io/projected/a460c5a9-6454-4f03-ad01-94be490f6344-kube-api-access-k5hrh\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-kubernetes\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019344 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1d47ea0-9913-4b9b-a755-43763e364ade-host-slash\") pod \"iptables-alerter-7qsvm\" (UID: \"e1d47ea0-9913-4b9b-a755-43763e364ade\") " pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-lib-modules\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-run-systemd\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019445 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-var-lib-openvswitch\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019467 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-etc-openvswitch\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.051920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019492 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4895\" (UniqueName: \"kubernetes.io/projected/81d26957-d758-4db7-a9e6-e04645877ec9-kube-api-access-x4895\") pod \"node-ca-kmm5f\" (UID: \"81d26957-d758-4db7-a9e6-e04645877ec9\") " pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019517 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-run-systemd\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-registration-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019539 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-var-lib-openvswitch\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019562 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-device-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-run\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019592 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-etc-openvswitch\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019612 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-hostroot\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-lib-modules\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c35106c-2c9b-4a81-b03f-801508924c93-multus-daemon-config\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-log-socket\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019666 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-host\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-run-multus-certs\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019680 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-hostroot\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-256mm\" (UniqueName: \"kubernetes.io/projected/8c35106c-2c9b-4a81-b03f-801508924c93-kube-api-access-256mm\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019730 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-run-multus-certs\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-host\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019747 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-systemd-units\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.052597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019720 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-run\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019774 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81d26957-d758-4db7-a9e6-e04645877ec9-serviceca\") pod \"node-ca-kmm5f\" (UID: \"81d26957-d758-4db7-a9e6-e04645877ec9\") " pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019790 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-systemd-units\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019798 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7c967a8-ef14-4b67-9bef-180b8e5a51bd-konnectivity-ca\") pod \"konnectivity-agent-5lqlk\" (UID: \"f7c967a8-ef14-4b67-9bef-180b8e5a51bd\") " pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019817 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-multus-cni-dir\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c35106c-2c9b-4a81-b03f-801508924c93-cni-binary-copy\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-log-socket\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019853 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktmth\" (UniqueName: \"kubernetes.io/projected/983cf437-5c6e-4277-b288-5c06c2350b97-kube-api-access-ktmth\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019883 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-sysctl-conf\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019922 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-node-log\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-var-lib-kubelet\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-cnibin\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019975 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-node-log\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-cni-netd\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019984 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-var-lib-kubelet\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.019983 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-multus-cni-dir\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b32cce8-a1c1-44b0-8b28-510526961c3e-ovnkube-script-lib\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020014 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-cni-netd\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053305 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020027 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-cnibin\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-sysctl-conf\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020016 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6-tmp-dir\") pod \"node-resolver-5csdk\" (UID: \"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6\") " pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020088 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020138 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-sys-fs\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020162 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7c967a8-ef14-4b67-9bef-180b8e5a51bd-agent-certs\") pod \"konnectivity-agent-5lqlk\" (UID: \"f7c967a8-ef14-4b67-9bef-180b8e5a51bd\") " pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020177 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-modprobe-d\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-sysconfig\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-multus-conf-dir\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020236 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e922c6d7-2a40-42a4-9940-6e18dcf34f88-dbus\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020258 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-multus-socket-dir-parent\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020281 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-run-openvswitch\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020283 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-modprobe-d\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020307 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-multus-conf-dir\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020327 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-sysconfig\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-run-openvswitch\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020305 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b32cce8-a1c1-44b0-8b28-510526961c3e-env-overrides\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.053858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020366 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-multus-socket-dir-parent\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6-hosts-file\") pod \"node-resolver-5csdk\" (UID: \"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6\") " pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a460c5a9-6454-4f03-ad01-94be490f6344-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-tuned\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020473 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-var-lib-kubelet\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020488 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-slash\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-cnibin\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1d47ea0-9913-4b9b-a755-43763e364ade-iptables-alerter-script\") pod \"iptables-alerter-7qsvm\" (UID: \"e1d47ea0-9913-4b9b-a755-43763e364ade\") " pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020536 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020538 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-slash\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-os-release\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-run-k8s-cni-cncf-io\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020570 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-var-lib-kubelet\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-var-lib-cni-multus\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-kubelet\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-socket-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020610 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-os-release\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.054487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e922c6d7-2a40-42a4-9940-6e18dcf34f88-kubelet-config\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020655 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-var-lib-cni-multus\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020677 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-run-k8s-cni-cncf-io\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020698 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-kubelet\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-sysctl-d\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f90dbc64-7174-4b0f-ba61-b058c96ae570-tmp\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9wfz\" (UniqueName: \"kubernetes.io/projected/f90dbc64-7174-4b0f-ba61-b058c96ae570-kube-api-access-r9wfz\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020783 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-var-lib-cni-bin\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020861 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg8n9\" (UniqueName: \"kubernetes.io/projected/3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6-kube-api-access-pg8n9\") pod \"node-resolver-5csdk\" (UID: \"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6\") " pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-669xf\" (UniqueName: \"kubernetes.io/projected/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-kube-api-access-669xf\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020904 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b32cce8-a1c1-44b0-8b28-510526961c3e-ovn-node-metrics-cert\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.020971 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-systemd\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021028 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-system-cni-dir\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021031 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-sysctl-d\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021027 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021053 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-var-lib-cni-bin\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-run-netns\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.055149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021139 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-run-netns\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021163 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021188 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-cni-bin\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021232 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a460c5a9-6454-4f03-ad01-94be490f6344-cni-binary-copy\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021261 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-sys\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-system-cni-dir\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021287 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-etc-kubernetes\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021292 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7c967a8-ef14-4b67-9bef-180b8e5a51bd-konnectivity-ca\") pod \"konnectivity-agent-5lqlk\" (UID: \"f7c967a8-ef14-4b67-9bef-180b8e5a51bd\") " pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021299 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b32cce8-a1c1-44b0-8b28-510526961c3e-env-overrides\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-run-ovn\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-cni-bin\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021360 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-host-run-netns\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021362 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-run-ovn\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021378 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c35106c-2c9b-4a81-b03f-801508924c93-etc-kubernetes\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-run-netns\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021396 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021421 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-sys\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.056088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b32cce8-a1c1-44b0-8b28-510526961c3e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b32cce8-a1c1-44b0-8b28-510526961c3e-ovnkube-config\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021444 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b32cce8-a1c1-44b0-8b28-510526961c3e-ovnkube-script-lib\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7z62\" (UniqueName: \"kubernetes.io/projected/5b32cce8-a1c1-44b0-8b28-510526961c3e-kube-api-access-v7z62\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021480 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-systemd\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021485 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021540 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a460c5a9-6454-4f03-ad01-94be490f6344-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021599 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81d26957-d758-4db7-a9e6-e04645877ec9-host\") pod \"node-ca-kmm5f\" (UID: \"81d26957-d758-4db7-a9e6-e04645877ec9\") " pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2wnx\" (UniqueName: \"kubernetes.io/projected/e1d47ea0-9913-4b9b-a755-43763e364ade-kube-api-access-b2wnx\") pod \"iptables-alerter-7qsvm\" (UID: \"e1d47ea0-9913-4b9b-a755-43763e364ade\") " pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c35106c-2c9b-4a81-b03f-801508924c93-multus-daemon-config\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021848 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c35106c-2c9b-4a81-b03f-801508924c93-cni-binary-copy\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.021876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b32cce8-a1c1-44b0-8b28-510526961c3e-ovnkube-config\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.024267 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f90dbc64-7174-4b0f-ba61-b058c96ae570-tmp\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.024295 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b32cce8-a1c1-44b0-8b28-510526961c3e-ovn-node-metrics-cert\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.024380 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7c967a8-ef14-4b67-9bef-180b8e5a51bd-agent-certs\") pod \"konnectivity-agent-5lqlk\" (UID: \"f7c967a8-ef14-4b67-9bef-180b8e5a51bd\") " pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.025919 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f90dbc64-7174-4b0f-ba61-b058c96ae570-etc-tuned\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.028162 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.028178 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 00:09:59.057603 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.028187 2573 projected.go:196] Error preparing data for projected volume kube-api-access-jz8sh for pod openshift-network-diagnostics/network-check-target-rztbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:09:59.058124 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.028236 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh podName:1234d087-10b5-4aa2-85c0-1ba9291db5f0 nodeName:}" failed. No retries permitted until 2026-07-08 00:09:59.528223471 +0000 UTC m=+2.007068707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jz8sh" (UniqueName: "kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh") pod "network-check-target-rztbr" (UID: "1234d087-10b5-4aa2-85c0-1ba9291db5f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:09:59.058124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.029841 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9wfz\" (UniqueName: \"kubernetes.io/projected/f90dbc64-7174-4b0f-ba61-b058c96ae570-kube-api-access-r9wfz\") pod \"tuned-m4krb\" (UID: \"f90dbc64-7174-4b0f-ba61-b058c96ae570\") " pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.058124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.030657 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-256mm\" (UniqueName: \"kubernetes.io/projected/8c35106c-2c9b-4a81-b03f-801508924c93-kube-api-access-256mm\") pod \"multus-nr874\" (UID: \"8c35106c-2c9b-4a81-b03f-801508924c93\") " pod="openshift-multus/multus-nr874" Jul 08 00:09:59.058124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.030782 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7z62\" (UniqueName: \"kubernetes.io/projected/5b32cce8-a1c1-44b0-8b28-510526961c3e-kube-api-access-v7z62\") pod \"ovnkube-node-zqqsq\" (UID: \"5b32cce8-a1c1-44b0-8b28-510526961c3e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.058124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.035460 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8vdsc" Jul 08 00:09:59.058124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.041985 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8vdsc" Jul 08 00:09:59.095252 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.095226 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 00:09:59.122539 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4895\" (UniqueName: \"kubernetes.io/projected/81d26957-d758-4db7-a9e6-e04645877ec9-kube-api-access-x4895\") pod \"node-ca-kmm5f\" (UID: \"81d26957-d758-4db7-a9e6-e04645877ec9\") " pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.122539 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122543 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-registration-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-device-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81d26957-d758-4db7-a9e6-e04645877ec9-serviceca\") pod \"node-ca-kmm5f\" (UID: \"81d26957-d758-4db7-a9e6-e04645877ec9\") " pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122619 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktmth\" (UniqueName: \"kubernetes.io/projected/983cf437-5c6e-4277-b288-5c06c2350b97-kube-api-access-ktmth\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6-tmp-dir\") pod \"node-resolver-5csdk\" (UID: \"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6\") " pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-registration-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-sys-fs\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122742 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e922c6d7-2a40-42a4-9940-6e18dcf34f88-dbus\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122769 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6-hosts-file\") pod \"node-resolver-5csdk\" (UID: \"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6\") " pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122780 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-device-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122794 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a460c5a9-6454-4f03-ad01-94be490f6344-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-cnibin\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122852 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e922c6d7-2a40-42a4-9940-6e18dcf34f88-dbus\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1d47ea0-9913-4b9b-a755-43763e364ade-iptables-alerter-script\") pod \"iptables-alerter-7qsvm\" (UID: \"e1d47ea0-9913-4b9b-a755-43763e364ade\") " pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122857 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6-hosts-file\") pod \"node-resolver-5csdk\" (UID: \"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6\") " pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.123813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122888 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122895 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6-tmp-dir\") pod \"node-resolver-5csdk\" (UID: \"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6\") " pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122915 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-cnibin\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122919 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-socket-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e922c6d7-2a40-42a4-9940-6e18dcf34f88-kubelet-config\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.122972 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg8n9\" (UniqueName: \"kubernetes.io/projected/3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6-kube-api-access-pg8n9\") pod \"node-resolver-5csdk\" (UID: \"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6\") " pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.123021 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret podName:e922c6d7-2a40-42a4-9940-6e18dcf34f88 nodeName:}" failed. No retries permitted until 2026-07-08 00:09:59.62300578 +0000 UTC m=+2.101851013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret") pod "global-pull-secret-syncer-gxr69" (UID: "e922c6d7-2a40-42a4-9940-6e18dcf34f88") : object "kube-system"/"original-pull-secret" not registered Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-669xf\" (UniqueName: \"kubernetes.io/projected/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-kube-api-access-669xf\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123060 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/81d26957-d758-4db7-a9e6-e04645877ec9-serviceca\") pod \"node-ca-kmm5f\" (UID: \"81d26957-d758-4db7-a9e6-e04645877ec9\") " pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123083 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a460c5a9-6454-4f03-ad01-94be490f6344-cni-binary-copy\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123143 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a460c5a9-6454-4f03-ad01-94be490f6344-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81d26957-d758-4db7-a9e6-e04645877ec9-host\") pod \"node-ca-kmm5f\" (UID: \"81d26957-d758-4db7-a9e6-e04645877ec9\") " pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2wnx\" (UniqueName: \"kubernetes.io/projected/e1d47ea0-9913-4b9b-a755-43763e364ade-kube-api-access-b2wnx\") pod \"iptables-alerter-7qsvm\" (UID: \"e1d47ea0-9913-4b9b-a755-43763e364ade\") " pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-system-cni-dir\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.124479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123259 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e922c6d7-2a40-42a4-9940-6e18dcf34f88-kubelet-config\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123275 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-os-release\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123325 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5hrh\" (UniqueName: \"kubernetes.io/projected/a460c5a9-6454-4f03-ad01-94be490f6344-kube-api-access-k5hrh\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.123342 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1d47ea0-9913-4b9b-a755-43763e364ade-host-slash\") pod \"iptables-alerter-7qsvm\" (UID: \"e1d47ea0-9913-4b9b-a755-43763e364ade\") " pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.123419 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs podName:ab3a86c6-12ef-4400-9c85-1263f4a7d02b nodeName:}" failed. No retries permitted until 2026-07-08 00:09:59.623392238 +0000 UTC m=+2.102237470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs") pod "network-metrics-daemon-qv87q" (UID: "ab3a86c6-12ef-4400-9c85-1263f4a7d02b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123418 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1d47ea0-9913-4b9b-a755-43763e364ade-host-slash\") pod \"iptables-alerter-7qsvm\" (UID: \"e1d47ea0-9913-4b9b-a755-43763e364ade\") " pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123423 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a460c5a9-6454-4f03-ad01-94be490f6344-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123040 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-socket-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123475 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81d26957-d758-4db7-a9e6-e04645877ec9-host\") pod \"node-ca-kmm5f\" (UID: \"81d26957-d758-4db7-a9e6-e04645877ec9\") " pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123486 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a460c5a9-6454-4f03-ad01-94be490f6344-cni-binary-copy\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1d47ea0-9913-4b9b-a755-43763e364ade-iptables-alerter-script\") pod \"iptables-alerter-7qsvm\" (UID: \"e1d47ea0-9913-4b9b-a755-43763e364ade\") " pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123522 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-system-cni-dir\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.122794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/983cf437-5c6e-4277-b288-5c06c2350b97-sys-fs\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.125042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.125610 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a460c5a9-6454-4f03-ad01-94be490f6344-os-release\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.125610 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.123952 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a460c5a9-6454-4f03-ad01-94be490f6344-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.132549 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.132523 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5hrh\" (UniqueName: \"kubernetes.io/projected/a460c5a9-6454-4f03-ad01-94be490f6344-kube-api-access-k5hrh\") pod \"multus-additional-cni-plugins-qmx4w\" (UID: \"a460c5a9-6454-4f03-ad01-94be490f6344\") " pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.132703 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.132576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg8n9\" (UniqueName: \"kubernetes.io/projected/3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6-kube-api-access-pg8n9\") pod \"node-resolver-5csdk\" (UID: \"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6\") " pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.132959 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.132932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktmth\" (UniqueName: \"kubernetes.io/projected/983cf437-5c6e-4277-b288-5c06c2350b97-kube-api-access-ktmth\") pod \"aws-ebs-csi-driver-node-7fjt9\" (UID: \"983cf437-5c6e-4277-b288-5c06c2350b97\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.133041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.132976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-669xf\" (UniqueName: \"kubernetes.io/projected/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-kube-api-access-669xf\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:09:59.133374 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.133353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2wnx\" (UniqueName: \"kubernetes.io/projected/e1d47ea0-9913-4b9b-a755-43763e364ade-kube-api-access-b2wnx\") pod \"iptables-alerter-7qsvm\" (UID: \"e1d47ea0-9913-4b9b-a755-43763e364ade\") " pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.133760 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.133726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4895\" (UniqueName: \"kubernetes.io/projected/81d26957-d758-4db7-a9e6-e04645877ec9-kube-api-access-x4895\") pod \"node-ca-kmm5f\" (UID: \"81d26957-d758-4db7-a9e6-e04645877ec9\") " pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.241289 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.241253 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae3497b7c0be2b9978bb06dee01133d.slice/crio-e667d96c6e8181e2564a3258ba3689672dbff1adb1c70e4cf2d435e41829819e WatchSource:0}: Error finding container e667d96c6e8181e2564a3258ba3689672dbff1adb1c70e4cf2d435e41829819e: Status 404 returned error can't find the container with id e667d96c6e8181e2564a3258ba3689672dbff1adb1c70e4cf2d435e41829819e Jul 08 00:09:59.241659 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.241639 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fad8567541d0738f8f57964a81b966.slice/crio-8172b5c9ec6a440a415d9448de547f6dbf0b8fd17f376226cfb595b63254172a WatchSource:0}: Error finding container 8172b5c9ec6a440a415d9448de547f6dbf0b8fd17f376226cfb595b63254172a: Status 404 returned error can't find the container with id 8172b5c9ec6a440a415d9448de547f6dbf0b8fd17f376226cfb595b63254172a Jul 08 00:09:59.244599 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.244581 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:09:59.246794 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.246778 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 00:09:59.254454 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.254430 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c967a8_ef14_4b67_9bef_180b8e5a51bd.slice/crio-dea42939fba2c8a6683735f304ade6a91706b3fe8582b77d9090c8a7a5c5e232 WatchSource:0}: Error finding container dea42939fba2c8a6683735f304ade6a91706b3fe8582b77d9090c8a7a5c5e232: Status 404 returned error can't find the container with id dea42939fba2c8a6683735f304ade6a91706b3fe8582b77d9090c8a7a5c5e232 Jul 08 00:09:59.266512 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.266487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4krb" Jul 08 00:09:59.274222 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.274194 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90dbc64_7174_4b0f_ba61_b058c96ae570.slice/crio-c9cf2edd1578604d742ba56bc12b2d308f4758aace8371d3b5671e62272810a4 WatchSource:0}: Error finding container c9cf2edd1578604d742ba56bc12b2d308f4758aace8371d3b5671e62272810a4: Status 404 returned error can't find the container with id c9cf2edd1578604d742ba56bc12b2d308f4758aace8371d3b5671e62272810a4 Jul 08 00:09:59.285784 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.285762 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nr874" Jul 08 00:09:59.293078 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.293058 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:09:59.293620 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.293599 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c35106c_2c9b_4a81_b03f_801508924c93.slice/crio-b175b9d75abe86649cbba932c596287236a641b748e3fb5fa77951ebba76cbbe WatchSource:0}: Error finding container b175b9d75abe86649cbba932c596287236a641b748e3fb5fa77951ebba76cbbe: Status 404 returned error can't find the container with id b175b9d75abe86649cbba932c596287236a641b748e3fb5fa77951ebba76cbbe Jul 08 00:09:59.301718 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.301665 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b32cce8_a1c1_44b0_8b28_510526961c3e.slice/crio-e1261cbf11be323cca3c011319eedd2ed7087a54f3101f665ef1de289a6da37f WatchSource:0}: Error finding container e1261cbf11be323cca3c011319eedd2ed7087a54f3101f665ef1de289a6da37f: Status 404 returned error can't find the container with id e1261cbf11be323cca3c011319eedd2ed7087a54f3101f665ef1de289a6da37f Jul 08 00:09:59.339511 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.339474 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" Jul 08 00:09:59.346951 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.346923 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983cf437_5c6e_4277_b288_5c06c2350b97.slice/crio-fe4173e74c31ac85cf248230f97d606fefae015c1fb44c4a2927bc12feb8ba91 WatchSource:0}: Error finding container fe4173e74c31ac85cf248230f97d606fefae015c1fb44c4a2927bc12feb8ba91: Status 404 returned error can't find the container with id fe4173e74c31ac85cf248230f97d606fefae015c1fb44c4a2927bc12feb8ba91 Jul 08 00:09:59.366829 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.366805 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5csdk" Jul 08 00:09:59.373949 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.373924 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9f40b5_d352_40b4_a58f_3a72ed5a8ba6.slice/crio-591352b4f3d72a4728b7e85f51c819abe353574e555beefb095886921de3cbf6 WatchSource:0}: Error finding container 591352b4f3d72a4728b7e85f51c819abe353574e555beefb095886921de3cbf6: Status 404 returned error can't find the container with id 591352b4f3d72a4728b7e85f51c819abe353574e555beefb095886921de3cbf6 Jul 08 00:09:59.383698 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.383678 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kmm5f" Jul 08 00:09:59.390774 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.390748 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d26957_d758_4db7_a9e6_e04645877ec9.slice/crio-2bb0af5544bcbf363706692012869b6325fe40ef43dc265599948e52d81e69cc WatchSource:0}: Error finding container 2bb0af5544bcbf363706692012869b6325fe40ef43dc265599948e52d81e69cc: Status 404 returned error can't find the container with id 2bb0af5544bcbf363706692012869b6325fe40ef43dc265599948e52d81e69cc Jul 08 00:09:59.413678 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.413648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" Jul 08 00:09:59.414698 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.414681 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7qsvm" Jul 08 00:09:59.423535 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.423504 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda460c5a9_6454_4f03_ad01_94be490f6344.slice/crio-43cd372d5caa76272b1b2e1db3a243fc10dae73f9472258a3577f6350ced06fc WatchSource:0}: Error finding container 43cd372d5caa76272b1b2e1db3a243fc10dae73f9472258a3577f6350ced06fc: Status 404 returned error can't find the container with id 43cd372d5caa76272b1b2e1db3a243fc10dae73f9472258a3577f6350ced06fc Jul 08 00:09:59.423815 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:09:59.423796 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d47ea0_9913_4b9b_a755_43763e364ade.slice/crio-1dc282a4df0276c8a8321c316ffbd253b5c67bed1c6ea1fbedce0ded27669a78 WatchSource:0}: Error finding container 1dc282a4df0276c8a8321c316ffbd253b5c67bed1c6ea1fbedce0ded27669a78: Status 404 returned error can't find the container with id 1dc282a4df0276c8a8321c316ffbd253b5c67bed1c6ea1fbedce0ded27669a78 Jul 08 00:09:59.425499 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.425480 2573 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-7qsvm_openshift-network-operator(e1d47ea0-9913-4b9b-a755-43763e364ade): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 08 00:09:59.425559 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.425516 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-7qsvm" podUID="e1d47ea0-9913-4b9b-a755-43763e364ade" Jul 08 00:09:59.628115 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.628061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:09:59.628280 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.628139 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:09:59.628280 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.628174 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:09:59.628280 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.628217 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 00:09:59.628280 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.628261 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:09:59.628460 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.628282 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 00:09:59.628460 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.628288 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret podName:e922c6d7-2a40-42a4-9940-6e18dcf34f88 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:00.628270747 +0000 UTC m=+3.107115979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret") pod "global-pull-secret-syncer-gxr69" (UID: "e922c6d7-2a40-42a4-9940-6e18dcf34f88") : object "kube-system"/"original-pull-secret" not registered Jul 08 00:09:59.628460 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.628298 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 00:09:59.628460 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.628308 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs podName:ab3a86c6-12ef-4400-9c85-1263f4a7d02b nodeName:}" failed. No retries permitted until 2026-07-08 00:10:00.628295235 +0000 UTC m=+3.107140467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs") pod "network-metrics-daemon-qv87q" (UID: "ab3a86c6-12ef-4400-9c85-1263f4a7d02b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:09:59.628460 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.628311 2573 projected.go:196] Error preparing data for projected volume kube-api-access-jz8sh for pod openshift-network-diagnostics/network-check-target-rztbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:09:59.628460 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.628364 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh podName:1234d087-10b5-4aa2-85c0-1ba9291db5f0 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:00.628350362 +0000 UTC m=+3.107195595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jz8sh" (UniqueName: "kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh") pod "network-check-target-rztbr" (UID: "1234d087-10b5-4aa2-85c0-1ba9291db5f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:09:59.681591 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:09:59.681564 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 00:09:59.756528 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.756474 2573 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280: reading manifest sha256:00aaa47e1b08f63b4600d9c19fd0b7f3d100d4b022fd98493aebf85d831b3693 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280" Jul 08 00:09:59.756696 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.756586 2573 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-5lqlk_kube-system(f7c967a8-ef14-4b67-9bef-180b8e5a51bd): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280: reading manifest sha256:00aaa47e1b08f63b4600d9c19fd0b7f3d100d4b022fd98493aebf85d831b3693 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 08 00:09:59.756696 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:09:59.756619 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280: reading manifest sha256:00aaa47e1b08f63b4600d9c19fd0b7f3d100d4b022fd98493aebf85d831b3693 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="kube-system/konnectivity-agent-5lqlk" podUID="f7c967a8-ef14-4b67-9bef-180b8e5a51bd" Jul 08 00:10:00.045605 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.045443 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 00:04:59 +0000 UTC" deadline="2028-01-26 01:02:55.474156327 +0000 UTC" Jul 08 00:10:00.045605 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.045504 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13608h52m55.428656103s" Jul 08 00:10:00.113577 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.112768 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:00.113577 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.112894 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:00.113577 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.113313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:00.113577 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.113421 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:00.129556 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.129451 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmm5f" event={"ID":"81d26957-d758-4db7-a9e6-e04645877ec9","Type":"ContainerStarted","Data":"2bb0af5544bcbf363706692012869b6325fe40ef43dc265599948e52d81e69cc"} Jul 08 00:10:00.137243 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.137149 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" event={"ID":"983cf437-5c6e-4277-b288-5c06c2350b97","Type":"ContainerStarted","Data":"fe4173e74c31ac85cf248230f97d606fefae015c1fb44c4a2927bc12feb8ba91"} Jul 08 00:10:00.143212 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.143178 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nr874" event={"ID":"8c35106c-2c9b-4a81-b03f-801508924c93","Type":"ContainerStarted","Data":"b175b9d75abe86649cbba932c596287236a641b748e3fb5fa77951ebba76cbbe"} Jul 08 00:10:00.158911 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.158868 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5lqlk" event={"ID":"f7c967a8-ef14-4b67-9bef-180b8e5a51bd","Type":"ContainerStarted","Data":"dea42939fba2c8a6683735f304ade6a91706b3fe8582b77d9090c8a7a5c5e232"} Jul 08 00:10:00.160651 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.160610 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280: reading manifest sha256:00aaa47e1b08f63b4600d9c19fd0b7f3d100d4b022fd98493aebf85d831b3693 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="kube-system/konnectivity-agent-5lqlk" podUID="f7c967a8-ef14-4b67-9bef-180b8e5a51bd" Jul 08 00:10:00.161836 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.161799 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal" event={"ID":"cae3497b7c0be2b9978bb06dee01133d","Type":"ContainerStarted","Data":"e667d96c6e8181e2564a3258ba3689672dbff1adb1c70e4cf2d435e41829819e"} Jul 08 00:10:00.166539 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.166487 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5csdk" event={"ID":"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6","Type":"ContainerStarted","Data":"591352b4f3d72a4728b7e85f51c819abe353574e555beefb095886921de3cbf6"} Jul 08 00:10:00.170148 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.170016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" event={"ID":"5b32cce8-a1c1-44b0-8b28-510526961c3e","Type":"ContainerStarted","Data":"e1261cbf11be323cca3c011319eedd2ed7087a54f3101f665ef1de289a6da37f"} Jul 08 00:10:00.178192 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.177726 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4krb" event={"ID":"f90dbc64-7174-4b0f-ba61-b058c96ae570","Type":"ContainerStarted","Data":"c9cf2edd1578604d742ba56bc12b2d308f4758aace8371d3b5671e62272810a4"} Jul 08 00:10:00.183693 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.183665 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" event={"ID":"d2fad8567541d0738f8f57964a81b966","Type":"ContainerStarted","Data":"8172b5c9ec6a440a415d9448de547f6dbf0b8fd17f376226cfb595b63254172a"} Jul 08 00:10:00.193299 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.192567 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7qsvm" event={"ID":"e1d47ea0-9913-4b9b-a755-43763e364ade","Type":"ContainerStarted","Data":"1dc282a4df0276c8a8321c316ffbd253b5c67bed1c6ea1fbedce0ded27669a78"} Jul 08 00:10:00.196499 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.196245 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:28389dd118629aa9d7c2525202f3ad6359afb98b6a3bf7672cb1ecfae2418e23\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-7qsvm" podUID="e1d47ea0-9913-4b9b-a755-43763e364ade" Jul 08 00:10:00.200290 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.200237 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" event={"ID":"a460c5a9-6454-4f03-ad01-94be490f6344","Type":"ContainerStarted","Data":"43cd372d5caa76272b1b2e1db3a243fc10dae73f9472258a3577f6350ced06fc"} Jul 08 00:10:00.637033 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.636988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:00.637243 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.637057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:00.637243 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:00.637108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:00.637356 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.637253 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 00:10:00.637356 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.637271 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 00:10:00.637356 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.637284 2573 projected.go:196] Error preparing data for projected volume kube-api-access-jz8sh for pod openshift-network-diagnostics/network-check-target-rztbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:00.637356 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.637343 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh podName:1234d087-10b5-4aa2-85c0-1ba9291db5f0 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:02.63732621 +0000 UTC m=+5.116171464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jz8sh" (UniqueName: "kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh") pod "network-check-target-rztbr" (UID: "1234d087-10b5-4aa2-85c0-1ba9291db5f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:00.637767 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.637747 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:00.637842 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.637801 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret podName:e922c6d7-2a40-42a4-9940-6e18dcf34f88 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:02.637786023 +0000 UTC m=+5.116631257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret") pod "global-pull-secret-syncer-gxr69" (UID: "e922c6d7-2a40-42a4-9940-6e18dcf34f88") : object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:00.637903 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.637861 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:00.637903 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:00.637894 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs podName:ab3a86c6-12ef-4400-9c85-1263f4a7d02b nodeName:}" failed. No retries permitted until 2026-07-08 00:10:02.637883064 +0000 UTC m=+5.116728300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs") pod "network-metrics-daemon-qv87q" (UID: "ab3a86c6-12ef-4400-9c85-1263f4a7d02b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:01.046254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:01.046154 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 00:04:59 +0000 UTC" deadline="2028-02-04 14:33:31.355466683 +0000 UTC" Jul 08 00:10:01.046254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:01.046190 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13838h23m30.309280706s" Jul 08 00:10:01.109638 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:01.109605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:01.109825 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:01.109741 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:02.110955 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:02.110227 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:02.110955 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.110357 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:02.110955 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:02.110743 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:02.110955 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.110849 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:02.652802 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:02.652756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:02.652998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:02.652835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:02.652998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:02.652873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:02.653120 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.653024 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 00:10:02.653120 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.653049 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 00:10:02.653120 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.653062 2573 projected.go:196] Error preparing data for projected volume kube-api-access-jz8sh for pod openshift-network-diagnostics/network-check-target-rztbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:02.653276 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.653142 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh podName:1234d087-10b5-4aa2-85c0-1ba9291db5f0 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:06.653122987 +0000 UTC m=+9.131968248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jz8sh" (UniqueName: "kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh") pod "network-check-target-rztbr" (UID: "1234d087-10b5-4aa2-85c0-1ba9291db5f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:02.653276 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.653218 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:02.653276 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.653253 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret podName:e922c6d7-2a40-42a4-9940-6e18dcf34f88 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:06.653240628 +0000 UTC m=+9.132085864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret") pod "global-pull-secret-syncer-gxr69" (UID: "e922c6d7-2a40-42a4-9940-6e18dcf34f88") : object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:02.653419 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.653308 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:02.653419 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:02.653338 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs podName:ab3a86c6-12ef-4400-9c85-1263f4a7d02b nodeName:}" failed. No retries permitted until 2026-07-08 00:10:06.653327027 +0000 UTC m=+9.132172265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs") pod "network-metrics-daemon-qv87q" (UID: "ab3a86c6-12ef-4400-9c85-1263f4a7d02b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:03.110218 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:03.110145 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:03.110365 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:03.110277 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:04.109930 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:04.109898 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:04.110384 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:04.109899 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:04.110384 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:04.110033 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:04.110384 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:04.110224 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:05.110444 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:05.110410 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:05.110915 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:05.110542 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:06.113528 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:06.113435 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:06.113528 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:06.113478 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:06.114021 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.113559 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:06.114021 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.113732 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:06.684362 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:06.684321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:06.684640 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:06.684401 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:06.684640 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:06.684450 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:06.684640 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.684572 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:06.684640 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.684646 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs podName:ab3a86c6-12ef-4400-9c85-1263f4a7d02b nodeName:}" failed. No retries permitted until 2026-07-08 00:10:14.684625972 +0000 UTC m=+17.163471218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs") pod "network-metrics-daemon-qv87q" (UID: "ab3a86c6-12ef-4400-9c85-1263f4a7d02b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:06.684889 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.684737 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 00:10:06.684889 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.684751 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 00:10:06.684889 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.684762 2573 projected.go:196] Error preparing data for projected volume kube-api-access-jz8sh for pod openshift-network-diagnostics/network-check-target-rztbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:06.684889 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.684797 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh podName:1234d087-10b5-4aa2-85c0-1ba9291db5f0 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:14.684786877 +0000 UTC m=+17.163632115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jz8sh" (UniqueName: "kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh") pod "network-check-target-rztbr" (UID: "1234d087-10b5-4aa2-85c0-1ba9291db5f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:06.684889 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.684853 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:06.684889 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:06.684885 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret podName:e922c6d7-2a40-42a4-9940-6e18dcf34f88 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:14.684875423 +0000 UTC m=+17.163720660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret") pod "global-pull-secret-syncer-gxr69" (UID: "e922c6d7-2a40-42a4-9940-6e18dcf34f88") : object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:07.110216 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:07.110135 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:07.110379 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:07.110262 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:08.110536 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:08.110451 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:08.110536 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:08.110532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:08.111037 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:08.110617 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:08.111037 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:08.110853 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:09.110240 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:09.110211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:09.110405 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:09.110339 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:10.110399 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.110175 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:10.110764 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.110184 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:10.110764 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:10.110432 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:10.110764 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:10.110526 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:10.223722 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.223687 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal" event={"ID":"cae3497b7c0be2b9978bb06dee01133d","Type":"ContainerStarted","Data":"f9d1c2fb9b7845625cd7e9266d3415e0371a1f7d4be6fbf69acfc0b1e0e910c9"} Jul 08 00:10:10.225467 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.225435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5csdk" event={"ID":"3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6","Type":"ContainerStarted","Data":"f6d09614a34bec918164b5bb9a80fef5211bbd94f7f6da19ae157848a4aa5a37"} Jul 08 00:10:10.227073 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.227001 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4krb" event={"ID":"f90dbc64-7174-4b0f-ba61-b058c96ae570","Type":"ContainerStarted","Data":"76c687e7f6376a00cb64ed4247071adbe413fbb75ae350a1c9634fa87b5845f3"} Jul 08 00:10:10.228829 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.228803 2573 generic.go:356] "Generic (PLEG): container finished" podID="d2fad8567541d0738f8f57964a81b966" containerID="3ea2dcb13770bce3531ba66881447c41513fe41decac971d396c4fb059701bc7" exitCode=0 Jul 08 00:10:10.228965 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.228838 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" event={"ID":"d2fad8567541d0738f8f57964a81b966","Type":"ContainerDied","Data":"3ea2dcb13770bce3531ba66881447c41513fe41decac971d396c4fb059701bc7"} Jul 08 00:10:10.230595 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.230570 2573 generic.go:356] "Generic (PLEG): container finished" podID="a460c5a9-6454-4f03-ad01-94be490f6344" containerID="983335a57a02fbba57166a1c129eaa573f8b24d1e74030f8263d18822f4ce69d" exitCode=0 Jul 08 00:10:10.230699 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.230597 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" event={"ID":"a460c5a9-6454-4f03-ad01-94be490f6344","Type":"ContainerDied","Data":"983335a57a02fbba57166a1c129eaa573f8b24d1e74030f8263d18822f4ce69d"} Jul 08 00:10:10.232379 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.232353 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kmm5f" event={"ID":"81d26957-d758-4db7-a9e6-e04645877ec9","Type":"ContainerStarted","Data":"30080326ea7e33d9448ea600b2a4e944c5b96f3a0799cd1e9bd46ee1b5720d0f"} Jul 08 00:10:10.233952 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.233931 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" event={"ID":"983cf437-5c6e-4277-b288-5c06c2350b97","Type":"ContainerStarted","Data":"a34e9d76cfc086b4bc3fe9e8c6bf29700327f841a931e37f191a35c04bb00404"} Jul 08 00:10:10.239934 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.239885 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-26.ec2.internal" podStartSLOduration=12.23986851 podStartE2EDuration="12.23986851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:10.239648654 +0000 UTC m=+12.718493932" watchObservedRunningTime="2026-07-08 00:10:10.23986851 +0000 UTC m=+12.718713765" Jul 08 00:10:10.259706 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.259651 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m4krb" podStartSLOduration=2.153731162 podStartE2EDuration="12.25963294s" totalImagesPullingTime="10.105901778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:10.259145365 +0000 UTC m=+12.737990619" watchObservedRunningTime="2026-07-08 00:10:10.25963294 +0000 UTC m=+12.738478195" Jul 08 00:10:10.274910 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.274844 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kmm5f" podStartSLOduration=2.307075425 podStartE2EDuration="12.274824774s" totalImagesPullingTime="9.967749349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:10.274741009 +0000 UTC m=+12.753586264" watchObservedRunningTime="2026-07-08 00:10:10.274824774 +0000 UTC m=+12.753670030" Jul 08 00:10:10.325906 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:10.325855 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5csdk" podStartSLOduration=2.343908407 podStartE2EDuration="12.325835909s" totalImagesPullingTime="9.981927502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:10.325681631 +0000 UTC m=+12.804526876" watchObservedRunningTime="2026-07-08 00:10:10.325835909 +0000 UTC m=+12.804681163" Jul 08 00:10:11.110688 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:11.110427 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:11.110688 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:11.110556 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:11.238330 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:11.238292 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" event={"ID":"d2fad8567541d0738f8f57964a81b966","Type":"ContainerStarted","Data":"e0f9efbc6d55c34c6f63ba2c2649313df459f6cdc24db9a9a19361aa2e4b07d4"} Jul 08 00:10:11.253223 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:11.253174 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-26.ec2.internal" podStartSLOduration=13.253155179 podStartE2EDuration="13.253155179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:11.253144955 +0000 UTC m=+13.731990209" watchObservedRunningTime="2026-07-08 00:10:11.253155179 +0000 UTC m=+13.732000434" Jul 08 00:10:11.686652 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:11.686628 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 00:10:12.018249 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:12.017914 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T00:10:11.686645829Z","UUID":"a0b33192-5e6b-4977-b744-9effa31d130f","Handler":null,"Name":"","Endpoint":""} Jul 08 00:10:12.019714 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:12.019680 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 00:10:12.019867 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:12.019726 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 00:10:12.110165 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:12.110130 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:12.110345 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:12.110265 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:12.110677 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:12.110656 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:12.110791 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:12.110769 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:12.243454 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:12.243346 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" event={"ID":"983cf437-5c6e-4277-b288-5c06c2350b97","Type":"ContainerStarted","Data":"cf90add0b39152ad87cfcf6e510511d8ee95d6083cab9b8bc22d53ae018e3477"} Jul 08 00:10:13.110062 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:13.110030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:13.110243 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:13.110213 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:13.246666 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:13.246626 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7qsvm" event={"ID":"e1d47ea0-9913-4b9b-a755-43763e364ade","Type":"ContainerStarted","Data":"764e3540e016942f7a687def238efc28ffce0d4a52d8bb456f1bee4fb9eb45b8"} Jul 08 00:10:13.261380 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:13.261317 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7qsvm" podStartSLOduration=15.261299495 podStartE2EDuration="15.261299495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-08 00:10:13.26086969 +0000 UTC m=+15.739714944" watchObservedRunningTime="2026-07-08 00:10:13.261299495 +0000 UTC m=+15.740144748" Jul 08 00:10:14.110234 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:14.110204 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:14.110423 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:14.110204 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:14.110423 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.110360 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:14.110533 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.110510 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:14.745063 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:14.745026 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:14.745086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:14.745136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.745203 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.745241 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.745258 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.745270 2573 projected.go:196] Error preparing data for projected volume kube-api-access-jz8sh for pod openshift-network-diagnostics/network-check-target-rztbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.745281 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret podName:e922c6d7-2a40-42a4-9940-6e18dcf34f88 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:30.745258965 +0000 UTC m=+33.224104212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret") pod "global-pull-secret-syncer-gxr69" (UID: "e922c6d7-2a40-42a4-9940-6e18dcf34f88") : object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.745317 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh podName:1234d087-10b5-4aa2-85c0-1ba9291db5f0 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:30.745301635 +0000 UTC m=+33.224146867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jz8sh" (UniqueName: "kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh") pod "network-check-target-rztbr" (UID: "1234d087-10b5-4aa2-85c0-1ba9291db5f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.745367 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:14.745547 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:14.745392 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs podName:ab3a86c6-12ef-4400-9c85-1263f4a7d02b nodeName:}" failed. No retries permitted until 2026-07-08 00:10:30.745383891 +0000 UTC m=+33.224229122 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs") pod "network-metrics-daemon-qv87q" (UID: "ab3a86c6-12ef-4400-9c85-1263f4a7d02b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:15.109838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:15.109760 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:15.110044 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:15.109900 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:16.110245 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:16.110211 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:16.110866 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:16.110217 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:16.110866 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:16.110351 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:16.110866 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:16.110410 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:17.110114 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:17.110061 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:17.110332 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:17.110209 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:18.110375 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:18.110336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:18.110375 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:18.110365 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:18.110981 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:18.110451 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:18.110981 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:18.110575 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:19.110174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:19.110138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:19.110345 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:19.110240 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:20.110087 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:20.110050 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:20.110621 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:20.110112 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:20.110621 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:20.110214 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:20.110621 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:20.110366 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:21.110215 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:21.110185 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:21.110710 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:21.110280 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:22.110350 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:22.110312 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:22.110350 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:22.110338 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:22.110838 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:22.110445 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:22.110838 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:22.110596 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:23.110111 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:23.110075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:23.110261 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:23.110194 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:24.112599 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.112306 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:24.113003 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.112372 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:24.113003 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:24.112680 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:24.113003 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:24.112743 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:24.269643 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.269606 2573 generic.go:356] "Generic (PLEG): container finished" podID="a460c5a9-6454-4f03-ad01-94be490f6344" containerID="b6b2d977ed3fda5292b14af6175cd30807374dfd2ae7430f479ba8c1cb090fd8" exitCode=0 Jul 08 00:10:24.269828 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.269692 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" event={"ID":"a460c5a9-6454-4f03-ad01-94be490f6344","Type":"ContainerDied","Data":"b6b2d977ed3fda5292b14af6175cd30807374dfd2ae7430f479ba8c1cb090fd8"} Jul 08 00:10:24.272058 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.272033 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" event={"ID":"983cf437-5c6e-4277-b288-5c06c2350b97","Type":"ContainerStarted","Data":"ec94dc702a9978774fe8f85fc8b11747408c4846255abaf0dba1592d8176f5e0"} Jul 08 00:10:24.273707 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.273682 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nr874" event={"ID":"8c35106c-2c9b-4a81-b03f-801508924c93","Type":"ContainerStarted","Data":"d6efc5f94ed846f2f2dee7f877d5fc4f0b0e67e578a0367bebdd56e925ac7a5b"} Jul 08 00:10:24.276615 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.276593 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5lqlk" event={"ID":"f7c967a8-ef14-4b67-9bef-180b8e5a51bd","Type":"ContainerStarted","Data":"f458cf89e92eb72f1e34e5c455af6e9c2d441b53b142bca4cf77eea8f6c9c746"} Jul 08 00:10:24.280038 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.280020 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" event={"ID":"5b32cce8-a1c1-44b0-8b28-510526961c3e","Type":"ContainerStarted","Data":"c01522c852c2db06ae582d3ee78c5021d796e013e3f1d7b20dbc27679412424c"} Jul 08 00:10:24.280148 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.280072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" event={"ID":"5b32cce8-a1c1-44b0-8b28-510526961c3e","Type":"ContainerStarted","Data":"fb20f0de2eb74ffadc146882b3e75a5c2a9171c34a1db916716b759786f9cfa8"} Jul 08 00:10:24.280148 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.280129 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" event={"ID":"5b32cce8-a1c1-44b0-8b28-510526961c3e","Type":"ContainerStarted","Data":"26a1a74b49aabd1b21729370ec143fbc2868f1a951129bc3d0da36fa5bd8ff0c"} Jul 08 00:10:24.280225 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.280160 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" event={"ID":"5b32cce8-a1c1-44b0-8b28-510526961c3e","Type":"ContainerStarted","Data":"8d215b22aad5848900fab29f58ab1987f958cf4d914bb05fb0b9a511117df694"} Jul 08 00:10:24.280225 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.280187 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" event={"ID":"5b32cce8-a1c1-44b0-8b28-510526961c3e","Type":"ContainerStarted","Data":"7cda8de26b537221db6135a0bfa3d9c29b2f80786b2d3ae715a00add76461cb2"} Jul 08 00:10:24.280225 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.280217 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" event={"ID":"5b32cce8-a1c1-44b0-8b28-510526961c3e","Type":"ContainerStarted","Data":"a92a4d160db38d4113c0d5dc15b0cf19e322bf43c6aaf37019e8d7266563e3d3"} Jul 08 00:10:24.312437 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.312366 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nr874" podStartSLOduration=2.074494512 podStartE2EDuration="26.312354145s" totalImagesPullingTime="24.237859633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:24.312068577 +0000 UTC m=+26.790913834" watchObservedRunningTime="2026-07-08 00:10:24.312354145 +0000 UTC m=+26.791199525" Jul 08 00:10:24.332782 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.332742 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fjt9" podStartSLOduration=2.7041129440000002 podStartE2EDuration="26.332729143s" totalImagesPullingTime="23.628616199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:24.332039772 +0000 UTC m=+26.810885026" watchObservedRunningTime="2026-07-08 00:10:24.332729143 +0000 UTC m=+26.811574397" Jul 08 00:10:24.345646 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:24.345610 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5lqlk" podStartSLOduration=2.038108865 podStartE2EDuration="26.345598148s" totalImagesPullingTime="24.307489283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-08 00:10:24.345560132 +0000 UTC m=+26.824405387" watchObservedRunningTime="2026-07-08 00:10:24.345598148 +0000 UTC m=+26.824443401" Jul 08 00:10:25.109530 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:25.109491 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:25.109733 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:25.109593 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:25.664569 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:25.664539 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:10:25.665160 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:25.665141 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:10:26.112718 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:26.112688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:26.112894 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:26.112791 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:26.112894 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:26.112846 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:26.112980 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:26.112921 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:26.288265 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:26.288228 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" event={"ID":"5b32cce8-a1c1-44b0-8b28-510526961c3e","Type":"ContainerStarted","Data":"c08bb65d9af9ac4b86bdfcf1e42b61da578caa618b62ddc458460921d5d118b0"} Jul 08 00:10:26.290539 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:26.290513 2573 generic.go:356] "Generic (PLEG): container finished" podID="a460c5a9-6454-4f03-ad01-94be490f6344" containerID="dc22ed1126911d22b75adae6face9968d65da1174419c2e52380c93dbc7f34d2" exitCode=0 Jul 08 00:10:26.290670 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:26.290596 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" event={"ID":"a460c5a9-6454-4f03-ad01-94be490f6344","Type":"ContainerDied","Data":"dc22ed1126911d22b75adae6face9968d65da1174419c2e52380c93dbc7f34d2"} Jul 08 00:10:26.290841 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:26.290821 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:10:26.291443 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:26.291381 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5lqlk" Jul 08 00:10:27.109804 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:27.109766 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:27.110484 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:27.109892 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:28.115286 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:28.115254 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:28.115867 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:28.115387 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:28.115867 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:28.115424 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:28.115867 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:28.115550 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:28.299621 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:28.299589 2573 generic.go:356] "Generic (PLEG): container finished" podID="a460c5a9-6454-4f03-ad01-94be490f6344" containerID="fd4bbfc2cf1d15ce2315e256f9e95b507bbd0dd2a10e77371982523e08e42484" exitCode=0 Jul 08 00:10:28.299775 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:28.299678 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" event={"ID":"a460c5a9-6454-4f03-ad01-94be490f6344","Type":"ContainerDied","Data":"fd4bbfc2cf1d15ce2315e256f9e95b507bbd0dd2a10e77371982523e08e42484"} Jul 08 00:10:29.110429 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:29.110172 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:29.110648 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:29.110535 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:29.305998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:29.305966 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" event={"ID":"5b32cce8-a1c1-44b0-8b28-510526961c3e","Type":"ContainerStarted","Data":"d7d23dc41b51bca22c19bdbd845f8e938b47ab10661ebed6047bde3533a37b1a"} Jul 08 00:10:29.306530 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:29.306195 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:10:29.321430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:29.321407 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:10:29.332255 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:29.332212 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" podStartSLOduration=7.102002076 podStartE2EDuration="31.332198397s" totalImagesPullingTime="24.230196321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:29.330433734 +0000 UTC m=+31.809279000" watchObservedRunningTime="2026-07-08 00:10:29.332198397 +0000 UTC m=+31.811043650" Jul 08 00:10:30.110283 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.109979 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:30.110283 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.110025 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:30.110283 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.110131 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:30.110283 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.110220 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:30.309124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.309071 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:10:30.309611 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.309168 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:10:30.324870 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.324848 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:10:30.404570 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.404479 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qv87q"] Jul 08 00:10:30.404728 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.404603 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:30.404728 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.404711 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:30.405160 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.405138 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rztbr"] Jul 08 00:10:30.405251 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.405238 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:30.405353 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.405334 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:30.406960 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.406940 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gxr69"] Jul 08 00:10:30.407054 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.407029 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:30.407161 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.407141 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:30.765843 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.765766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:30.765843 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.765806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:30.765843 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:30.765828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:30.766085 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.765913 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:30.766085 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.765919 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:30.766085 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.765919 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 00:10:30.766085 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.765973 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret podName:e922c6d7-2a40-42a4-9940-6e18dcf34f88 nodeName:}" failed. No retries permitted until 2026-07-08 00:11:02.76595689 +0000 UTC m=+65.244802126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret") pod "global-pull-secret-syncer-gxr69" (UID: "e922c6d7-2a40-42a4-9940-6e18dcf34f88") : object "kube-system"/"original-pull-secret" not registered Jul 08 00:10:30.766085 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.765977 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 00:10:30.766085 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.765987 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs podName:ab3a86c6-12ef-4400-9c85-1263f4a7d02b nodeName:}" failed. No retries permitted until 2026-07-08 00:11:02.765980155 +0000 UTC m=+65.244825387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs") pod "network-metrics-daemon-qv87q" (UID: "ab3a86c6-12ef-4400-9c85-1263f4a7d02b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 00:10:30.766085 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.765991 2573 projected.go:196] Error preparing data for projected volume kube-api-access-jz8sh for pod openshift-network-diagnostics/network-check-target-rztbr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:30.766085 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:30.766033 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh podName:1234d087-10b5-4aa2-85c0-1ba9291db5f0 nodeName:}" failed. No retries permitted until 2026-07-08 00:11:02.766016044 +0000 UTC m=+65.244861277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jz8sh" (UniqueName: "kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh") pod "network-check-target-rztbr" (UID: "1234d087-10b5-4aa2-85c0-1ba9291db5f0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 00:10:32.110294 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:32.110262 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:32.110650 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:32.110266 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:32.110650 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:32.110360 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:32.110650 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:32.110427 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:32.110650 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:32.110464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:32.110650 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:32.110525 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:34.110033 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:34.109995 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:34.110508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:34.109995 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:34.110508 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:34.110150 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:34.110508 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:34.110215 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:34.110508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:34.110003 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:34.110508 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:34.110378 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:36.110512 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.110352 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:36.110901 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.110352 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:36.110901 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:36.110594 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gxr69" podUID="e922c6d7-2a40-42a4-9940-6e18dcf34f88" Jul 08 00:10:36.110901 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.110379 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:36.110901 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:36.110659 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rztbr" podUID="1234d087-10b5-4aa2-85c0-1ba9291db5f0" Jul 08 00:10:36.110901 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:36.110764 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qv87q" podUID="ab3a86c6-12ef-4400-9c85-1263f4a7d02b" Jul 08 00:10:36.324676 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.324649 2573 generic.go:356] "Generic (PLEG): container finished" podID="a460c5a9-6454-4f03-ad01-94be490f6344" containerID="54114f72888f9457f52311c84c94695d065c31d2f7e2ead02607f9ed1f38a88d" exitCode=0 Jul 08 00:10:36.324768 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.324694 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" event={"ID":"a460c5a9-6454-4f03-ad01-94be490f6344","Type":"ContainerDied","Data":"54114f72888f9457f52311c84c94695d065c31d2f7e2ead02607f9ed1f38a88d"} Jul 08 00:10:36.349024 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.348995 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-26.ec2.internal" event="NodeReady" Jul 08 00:10:36.349184 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.349129 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 00:10:36.381872 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.381823 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c85668cb9-h9w6p"] Jul 08 00:10:36.403183 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.403140 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m8jbt"] Jul 08 00:10:36.403306 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.403260 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.406682 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.406032 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8jfk\"" Jul 08 00:10:36.406682 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.406279 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 00:10:36.406682 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.406497 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 00:10:36.407317 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.407147 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 00:10:36.411732 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.411714 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 00:10:36.425371 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.425351 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xz689"] Jul 08 00:10:36.425490 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.425474 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.428126 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.428092 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 00:10:36.428126 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.428118 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 00:10:36.428245 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.428125 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kx7hf\"" Jul 08 00:10:36.444986 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.444959 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c85668cb9-h9w6p"] Jul 08 00:10:36.445108 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.444993 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8jbt"] Jul 08 00:10:36.445108 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.445018 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xz689"] Jul 08 00:10:36.445184 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.445113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xz689" Jul 08 00:10:36.447845 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.447824 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 00:10:36.447978 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.447959 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 00:10:36.448046 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.447981 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5p6jq\"" Jul 08 00:10:36.448046 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.447992 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 00:10:36.506794 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.506635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-tmp-dir\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.506794 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.506684 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-bound-sa-token\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.506888 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.506850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-image-registry-private-configuration\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.506935 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.506887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-certificates\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.506983 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.506938 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-ca-trust-extracted\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.507030 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.506976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-installation-pull-secrets\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.507030 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.507007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.507152 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.507032 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6cxs\" (UniqueName: \"kubernetes.io/projected/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-kube-api-access-b6cxs\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.507152 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.507072 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-trusted-ca\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.507152 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.507125 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-config-volume\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.507312 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.507149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.507312 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.507174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np5xw\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-kube-api-access-np5xw\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.557542 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.557508 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:36.607641 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607604 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-bound-sa-token\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.607753 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-image-registry-private-configuration\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.607753 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-certificates\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.607753 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a93cca2-2333-4667-bd1d-20422aec61f3-cert\") pod \"ingress-canary-xz689\" (UID: \"0a93cca2-2333-4667-bd1d-20422aec61f3\") " pod="openshift-ingress-canary/ingress-canary-xz689" Jul 08 00:10:36.607907 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-ca-trust-extracted\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.607907 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-installation-pull-secrets\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.607907 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607847 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvpzd\" (UniqueName: \"kubernetes.io/projected/0a93cca2-2333-4667-bd1d-20422aec61f3-kube-api-access-nvpzd\") pod \"ingress-canary-xz689\" (UID: \"0a93cca2-2333-4667-bd1d-20422aec61f3\") " pod="openshift-ingress-canary/ingress-canary-xz689" Jul 08 00:10:36.607907 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607876 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.607907 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6cxs\" (UniqueName: \"kubernetes.io/projected/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-kube-api-access-b6cxs\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.608145 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607919 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-trusted-ca\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.608145 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-config-volume\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.608145 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.607969 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.608145 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:36.608006 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 00:10:36.608145 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:36.608082 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls podName:d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:37.108059713 +0000 UTC m=+39.586904962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls") pod "dns-default-m8jbt" (UID: "d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1") : secret "dns-default-metrics-tls" not found Jul 08 00:10:36.608391 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.608283 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-ca-trust-extracted\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.608391 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.608340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np5xw\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-kube-api-access-np5xw\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.608391 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.608378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-tmp-dir\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.608531 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.608437 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-certificates\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.608587 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.608575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-config-volume\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.608641 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:36.608595 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 00:10:36.608641 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:36.608609 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c85668cb9-h9w6p: secret "image-registry-tls" not found Jul 08 00:10:36.608731 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:36.608666 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls podName:2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:37.108644836 +0000 UTC m=+39.587490086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls") pod "image-registry-6c85668cb9-h9w6p" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04") : secret "image-registry-tls" not found Jul 08 00:10:36.608792 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.608775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-tmp-dir\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.608960 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.608943 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-trusted-ca\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.611927 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.611903 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-image-registry-private-configuration\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.611927 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.611923 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-installation-pull-secrets\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.616340 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.616318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-bound-sa-token\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.616418 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.616400 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6cxs\" (UniqueName: \"kubernetes.io/projected/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-kube-api-access-b6cxs\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:36.617023 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.617004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np5xw\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-kube-api-access-np5xw\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:36.637188 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.637164 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:36.709380 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.709351 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a93cca2-2333-4667-bd1d-20422aec61f3-cert\") pod \"ingress-canary-xz689\" (UID: \"0a93cca2-2333-4667-bd1d-20422aec61f3\") " pod="openshift-ingress-canary/ingress-canary-xz689" Jul 08 00:10:36.709529 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.709394 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvpzd\" (UniqueName: \"kubernetes.io/projected/0a93cca2-2333-4667-bd1d-20422aec61f3-kube-api-access-nvpzd\") pod \"ingress-canary-xz689\" (UID: \"0a93cca2-2333-4667-bd1d-20422aec61f3\") " pod="openshift-ingress-canary/ingress-canary-xz689" Jul 08 00:10:36.711737 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.711687 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a93cca2-2333-4667-bd1d-20422aec61f3-cert\") pod \"ingress-canary-xz689\" (UID: \"0a93cca2-2333-4667-bd1d-20422aec61f3\") " pod="openshift-ingress-canary/ingress-canary-xz689" Jul 08 00:10:36.717233 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.717215 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvpzd\" (UniqueName: \"kubernetes.io/projected/0a93cca2-2333-4667-bd1d-20422aec61f3-kube-api-access-nvpzd\") pod \"ingress-canary-xz689\" (UID: \"0a93cca2-2333-4667-bd1d-20422aec61f3\") " pod="openshift-ingress-canary/ingress-canary-xz689" Jul 08 00:10:36.753377 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.753353 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xz689" Jul 08 00:10:36.921165 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:36.921137 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xz689"] Jul 08 00:10:36.925395 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:10:36.925257 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a93cca2_2333_4667_bd1d_20422aec61f3.slice/crio-8fb84fd204391bd139f69749489774b61b81ac398bb8dfa550ddbc3bf0947167 WatchSource:0}: Error finding container 8fb84fd204391bd139f69749489774b61b81ac398bb8dfa550ddbc3bf0947167: Status 404 returned error can't find the container with id 8fb84fd204391bd139f69749489774b61b81ac398bb8dfa550ddbc3bf0947167 Jul 08 00:10:37.112473 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:37.112442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:37.113251 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:37.112491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:37.113251 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:37.112590 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 00:10:37.113251 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:37.112657 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls podName:d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:38.11263925 +0000 UTC m=+40.591484481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls") pod "dns-default-m8jbt" (UID: "d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1") : secret "dns-default-metrics-tls" not found Jul 08 00:10:37.113251 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:37.112684 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 00:10:37.113251 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:37.112702 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c85668cb9-h9w6p: secret "image-registry-tls" not found Jul 08 00:10:37.113251 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:37.112762 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls podName:2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:38.112741654 +0000 UTC m=+40.591586895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls") pod "image-registry-6c85668cb9-h9w6p" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04") : secret "image-registry-tls" not found Jul 08 00:10:37.329640 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:37.329607 2573 generic.go:356] "Generic (PLEG): container finished" podID="a460c5a9-6454-4f03-ad01-94be490f6344" containerID="347f0dbdd174b39f5172800caef7701e46eb92d7d38c2b49300ca3fdba60616d" exitCode=0 Jul 08 00:10:37.329813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:37.329693 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" event={"ID":"a460c5a9-6454-4f03-ad01-94be490f6344","Type":"ContainerDied","Data":"347f0dbdd174b39f5172800caef7701e46eb92d7d38c2b49300ca3fdba60616d"} Jul 08 00:10:37.330865 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:37.330842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xz689" event={"ID":"0a93cca2-2333-4667-bd1d-20422aec61f3","Type":"ContainerStarted","Data":"8fb84fd204391bd139f69749489774b61b81ac398bb8dfa550ddbc3bf0947167"} Jul 08 00:10:38.111482 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.111445 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:10:38.111678 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.111533 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:10:38.111678 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.111580 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:10:38.114329 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.114305 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 00:10:38.114667 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.114355 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 00:10:38.115697 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.115581 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 00:10:38.115697 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.115582 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kstgw\"" Jul 08 00:10:38.115697 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.115637 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 00:10:38.115697 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.115675 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-czrvf\"" Jul 08 00:10:38.119747 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.119725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:38.119833 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.119778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:38.119910 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:38.119893 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 00:10:38.119970 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:38.119959 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls podName:d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:40.119939583 +0000 UTC m=+42.598784830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls") pod "dns-default-m8jbt" (UID: "d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1") : secret "dns-default-metrics-tls" not found Jul 08 00:10:38.120028 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:38.119983 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 00:10:38.120028 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:38.119997 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c85668cb9-h9w6p: secret "image-registry-tls" not found Jul 08 00:10:38.120164 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:38.120050 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls podName:2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:40.120038321 +0000 UTC m=+42.598883556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls") pod "image-registry-6c85668cb9-h9w6p" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04") : secret "image-registry-tls" not found Jul 08 00:10:38.335968 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.335928 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" event={"ID":"a460c5a9-6454-4f03-ad01-94be490f6344","Type":"ContainerStarted","Data":"d0379d91371f8ceb98e0afa945f80be40a48edd94ca3c3a54210fc8f69e9400b"} Jul 08 00:10:38.361440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.361390 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qmx4w" podStartSLOduration=6.575360549 podStartE2EDuration="40.361372011s" totalImagesPullingTime="33.786011462s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:38.360540589 +0000 UTC m=+40.839385844" watchObservedRunningTime="2026-07-08 00:10:38.361372011 +0000 UTC m=+40.840217267" Jul 08 00:10:38.453143 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.453026 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:38.510316 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.510286 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:38.611998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:38.611963 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:40.133757 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:40.133723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:40.133757 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:40.133763 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:40.134215 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:40.133873 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 00:10:40.134215 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:40.133929 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls podName:d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:44.13391421 +0000 UTC m=+46.612759446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls") pod "dns-default-m8jbt" (UID: "d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1") : secret "dns-default-metrics-tls" not found Jul 08 00:10:40.134215 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:40.133876 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 00:10:40.134215 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:40.133952 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c85668cb9-h9w6p: secret "image-registry-tls" not found Jul 08 00:10:40.134215 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:40.133982 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls podName:2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:44.133973713 +0000 UTC m=+46.612818953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls") pod "image-registry-6c85668cb9-h9w6p" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04") : secret "image-registry-tls" not found Jul 08 00:10:40.341484 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:40.341451 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xz689" event={"ID":"0a93cca2-2333-4667-bd1d-20422aec61f3","Type":"ContainerStarted","Data":"d8d3f03711b6ba682bd657d02278331de4050377e13853239f6bd2f6026b8173"} Jul 08 00:10:40.358066 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:40.358015 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xz689" podStartSLOduration=1.664132298 podStartE2EDuration="4.358000048s" totalImagesPullingTime="2.69386775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:40.356549847 +0000 UTC m=+42.835395100" watchObservedRunningTime="2026-07-08 00:10:40.358000048 +0000 UTC m=+42.836845302" Jul 08 00:10:40.431495 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:40.431461 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:43.061702 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:43.061536 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:43.116175 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:43.116146 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:44.163138 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:44.163076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:44.163138 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:44.163135 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:44.163562 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:44.163233 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 00:10:44.163562 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:44.163248 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c85668cb9-h9w6p: secret "image-registry-tls" not found Jul 08 00:10:44.163562 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:44.163290 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls podName:2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:52.16327713 +0000 UTC m=+54.642122362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls") pod "image-registry-6c85668cb9-h9w6p" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04") : secret "image-registry-tls" not found Jul 08 00:10:44.163562 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:44.163233 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 00:10:44.163562 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:44.163388 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls podName:d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1 nodeName:}" failed. No retries permitted until 2026-07-08 00:10:52.16337399 +0000 UTC m=+54.642219236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls") pod "dns-default-m8jbt" (UID: "d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1") : secret "dns-default-metrics-tls" not found Jul 08 00:10:44.190665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:44.190634 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:44.292312 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:44.292278 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:45.933498 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:45.933462 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ns4jb"] Jul 08 00:10:45.961838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:45.961808 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ns4jb"] Jul 08 00:10:45.961985 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:45.961917 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:45.965406 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:45.965382 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 00:10:45.965531 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:45.965418 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 00:10:45.965671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:45.965660 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 00:10:45.966651 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:45.966637 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 00:10:45.966699 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:45.966685 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ksrf\"" Jul 08 00:10:46.019185 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.019151 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:46.075697 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.075668 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e2a553f-466a-48c0-a8ed-23e1b790212e-data-volume\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.075770 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.075720 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e2a553f-466a-48c0-a8ed-23e1b790212e-crio-socket\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.075770 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.075744 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.075770 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.075761 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pxv5\" (UniqueName: \"kubernetes.io/projected/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-api-access-9pxv5\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.075951 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.075830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.079662 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.079640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:46.177051 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.177015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e2a553f-466a-48c0-a8ed-23e1b790212e-data-volume\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.177051 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.177059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e2a553f-466a-48c0-a8ed-23e1b790212e-crio-socket\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.177317 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.177180 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.177317 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.177263 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pxv5\" (UniqueName: \"kubernetes.io/projected/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-api-access-9pxv5\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.177317 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:46.177307 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 00:10:46.177447 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.177323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.177447 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.177338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e2a553f-466a-48c0-a8ed-23e1b790212e-data-volume\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.177447 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.177266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e2a553f-466a-48c0-a8ed-23e1b790212e-crio-socket\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.177447 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:46.177381 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:10:46.677365268 +0000 UTC m=+49.156210520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : configmap "kube-rbac-proxy" not found Jul 08 00:10:46.177595 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:46.177530 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 00:10:46.177595 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:46.177573 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:10:46.677561554 +0000 UTC m=+49.156406786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : secret "insights-runtime-extractor-tls" not found Jul 08 00:10:46.187367 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.187301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pxv5\" (UniqueName: \"kubernetes.io/projected/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-api-access-9pxv5\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.281943 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.281892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:46.334839 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.334759 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:46.680666 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.680627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.680871 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.680686 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:46.680871 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:46.680757 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 00:10:46.680871 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:46.680833 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:10:47.680811462 +0000 UTC m=+50.159656694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : configmap "kube-rbac-proxy" not found Jul 08 00:10:46.680871 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:46.680836 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 00:10:46.681043 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:46.680883 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:10:47.680871329 +0000 UTC m=+50.159716562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : secret "insights-runtime-extractor-tls" not found Jul 08 00:10:46.819677 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.819640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:46.822210 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.822185 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5"] Jul 08 00:10:46.841383 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.841356 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5"] Jul 08 00:10:46.841502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.841451 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5" Jul 08 00:10:46.845409 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.845386 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 00:10:46.845532 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.845390 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d9smc\"" Jul 08 00:10:46.845532 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.845390 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 00:10:46.912771 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.912739 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:46.984418 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:46.984319 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-877dz\" (UniqueName: \"kubernetes.io/projected/f28e0a81-be80-406c-8f99-10baf8df959f-kube-api-access-877dz\") pod \"migrator-d57d58cc9-898m5\" (UID: \"f28e0a81-be80-406c-8f99-10baf8df959f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5" Jul 08 00:10:47.013774 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.013743 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:47.085180 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.085142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-877dz\" (UniqueName: \"kubernetes.io/projected/f28e0a81-be80-406c-8f99-10baf8df959f-kube-api-access-877dz\") pod \"migrator-d57d58cc9-898m5\" (UID: \"f28e0a81-be80-406c-8f99-10baf8df959f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5" Jul 08 00:10:47.093777 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.093747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-877dz\" (UniqueName: \"kubernetes.io/projected/f28e0a81-be80-406c-8f99-10baf8df959f-kube-api-access-877dz\") pod \"migrator-d57d58cc9-898m5\" (UID: \"f28e0a81-be80-406c-8f99-10baf8df959f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5" Jul 08 00:10:47.150395 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.150358 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5" Jul 08 00:10:47.291767 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.291738 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5"] Jul 08 00:10:47.294812 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:10:47.294784 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28e0a81_be80_406c_8f99_10baf8df959f.slice/crio-6293c718192a0a79aa52e185e7f60810fd9dca653ab280c1114f132a8f5f176f WatchSource:0}: Error finding container 6293c718192a0a79aa52e185e7f60810fd9dca653ab280c1114f132a8f5f176f: Status 404 returned error can't find the container with id 6293c718192a0a79aa52e185e7f60810fd9dca653ab280c1114f132a8f5f176f Jul 08 00:10:47.359192 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.359157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5" event={"ID":"f28e0a81-be80-406c-8f99-10baf8df959f","Type":"ContainerStarted","Data":"6293c718192a0a79aa52e185e7f60810fd9dca653ab280c1114f132a8f5f176f"} Jul 08 00:10:47.372557 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.372533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5csdk_3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6/dns-node-resolver/0.log" Jul 08 00:10:47.690379 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.690342 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:47.690555 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.690392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:47.690555 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:47.690469 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 00:10:47.690555 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:47.690488 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 00:10:47.690555 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:47.690534 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:10:49.690518454 +0000 UTC m=+52.169363686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : configmap "kube-rbac-proxy" not found Jul 08 00:10:47.690555 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:47.690547 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:10:49.690541222 +0000 UTC m=+52.169386454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : secret "insights-runtime-extractor-tls" not found Jul 08 00:10:47.976183 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:47.976079 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:48.071863 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.071834 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:48.504031 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.504000 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hf9ls"] Jul 08 00:10:48.517356 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.517332 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hf9ls"] Jul 08 00:10:48.517507 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.517419 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.520046 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.520021 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 08 00:10:48.520179 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.520083 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 08 00:10:48.521350 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.521328 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bp7db\"" Jul 08 00:10:48.521448 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.521393 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 08 00:10:48.521448 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.521394 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 08 00:10:48.535733 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.535711 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:48.572866 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.572843 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmm5f_81d26957-d758-4db7-a9e6-e04645877ec9/node-ca/0.log" Jul 08 00:10:48.590349 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.590328 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:48.596402 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.596385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ae381675-5fa6-47a9-a96b-e5dfbded8015-signing-cabundle\") pod \"service-ca-758f599c5-hf9ls\" (UID: \"ae381675-5fa6-47a9-a96b-e5dfbded8015\") " pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.596545 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.596530 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ae381675-5fa6-47a9-a96b-e5dfbded8015-signing-key\") pod \"service-ca-758f599c5-hf9ls\" (UID: \"ae381675-5fa6-47a9-a96b-e5dfbded8015\") " pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.596583 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.596554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m9tj\" (UniqueName: \"kubernetes.io/projected/ae381675-5fa6-47a9-a96b-e5dfbded8015-kube-api-access-2m9tj\") pod \"service-ca-758f599c5-hf9ls\" (UID: \"ae381675-5fa6-47a9-a96b-e5dfbded8015\") " pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.697803 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.697771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ae381675-5fa6-47a9-a96b-e5dfbded8015-signing-key\") pod \"service-ca-758f599c5-hf9ls\" (UID: \"ae381675-5fa6-47a9-a96b-e5dfbded8015\") " pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.697803 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.697805 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m9tj\" (UniqueName: \"kubernetes.io/projected/ae381675-5fa6-47a9-a96b-e5dfbded8015-kube-api-access-2m9tj\") pod \"service-ca-758f599c5-hf9ls\" (UID: \"ae381675-5fa6-47a9-a96b-e5dfbded8015\") " pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.698029 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.697833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ae381675-5fa6-47a9-a96b-e5dfbded8015-signing-cabundle\") pod \"service-ca-758f599c5-hf9ls\" (UID: \"ae381675-5fa6-47a9-a96b-e5dfbded8015\") " pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.698548 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.698519 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ae381675-5fa6-47a9-a96b-e5dfbded8015-signing-cabundle\") pod \"service-ca-758f599c5-hf9ls\" (UID: \"ae381675-5fa6-47a9-a96b-e5dfbded8015\") " pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.703452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.700323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ae381675-5fa6-47a9-a96b-e5dfbded8015-signing-key\") pod \"service-ca-758f599c5-hf9ls\" (UID: \"ae381675-5fa6-47a9-a96b-e5dfbded8015\") " pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.706771 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.706749 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m9tj\" (UniqueName: \"kubernetes.io/projected/ae381675-5fa6-47a9-a96b-e5dfbded8015-kube-api-access-2m9tj\") pod \"service-ca-758f599c5-hf9ls\" (UID: \"ae381675-5fa6-47a9-a96b-e5dfbded8015\") " pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:48.826870 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:48.826838 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hf9ls" Jul 08 00:10:49.090760 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:49.090693 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hf9ls"] Jul 08 00:10:49.184730 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:10:49.184699 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae381675_5fa6_47a9_a96b_e5dfbded8015.slice/crio-c7103b1a59a00b5513fa1496f9d59bc93898328e92e8a0179d1601ef5acad2e1 WatchSource:0}: Error finding container c7103b1a59a00b5513fa1496f9d59bc93898328e92e8a0179d1601ef5acad2e1: Status 404 returned error can't find the container with id c7103b1a59a00b5513fa1496f9d59bc93898328e92e8a0179d1601ef5acad2e1 Jul 08 00:10:49.365909 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:49.365873 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5" event={"ID":"f28e0a81-be80-406c-8f99-10baf8df959f","Type":"ContainerStarted","Data":"a5533f0f2b9c2620087c847f88e7d6ba28acd34ec8db82ed483f38e81cabbbac"} Jul 08 00:10:49.366920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:49.366892 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hf9ls" event={"ID":"ae381675-5fa6-47a9-a96b-e5dfbded8015","Type":"ContainerStarted","Data":"c7103b1a59a00b5513fa1496f9d59bc93898328e92e8a0179d1601ef5acad2e1"} Jul 08 00:10:49.373551 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:49.373533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xz689_0a93cca2-2333-4667-bd1d-20422aec61f3/serve-healthcheck-canary/0.log" Jul 08 00:10:49.525035 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:49.525001 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:49.705496 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:49.705418 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:49.705615 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:49.705537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:49.705615 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:49.705586 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 00:10:49.705615 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:49.705607 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 00:10:49.705719 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:49.705653 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:10:53.705633381 +0000 UTC m=+56.184478617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : secret "insights-runtime-extractor-tls" not found Jul 08 00:10:49.705719 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:49.705669 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:10:53.705661617 +0000 UTC m=+56.184506854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : configmap "kube-rbac-proxy" not found Jul 08 00:10:50.371506 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:50.371469 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5" event={"ID":"f28e0a81-be80-406c-8f99-10baf8df959f","Type":"ContainerStarted","Data":"a4b332f1e4b0d3a9fa30ac76d4575069b4f5749fe1784e950331e0e9e000d3d1"} Jul 08 00:10:50.390882 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:50.390834 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-898m5" podStartSLOduration=2.483363746 podStartE2EDuration="4.390819142s" totalImagesPullingTime="1.907455396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:50.388990957 +0000 UTC m=+52.867836212" watchObservedRunningTime="2026-07-08 00:10:50.390819142 +0000 UTC m=+52.869664396" Jul 08 00:10:51.849715 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:51.849682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:52.227457 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:52.227377 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:10:52.227598 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:52.227526 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 00:10:52.227598 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:52.227540 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:10:52.227598 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:52.227545 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c85668cb9-h9w6p: secret "image-registry-tls" not found Jul 08 00:10:52.227598 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:52.227584 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 00:10:52.227718 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:52.227608 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls podName:2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04 nodeName:}" failed. No retries permitted until 2026-07-08 00:11:08.227595002 +0000 UTC m=+70.706440239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls") pod "image-registry-6c85668cb9-h9w6p" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04") : secret "image-registry-tls" not found Jul 08 00:10:52.227718 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:52.227622 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls podName:d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1 nodeName:}" failed. No retries permitted until 2026-07-08 00:11:08.227616252 +0000 UTC m=+70.706461484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls") pod "dns-default-m8jbt" (UID: "d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1") : secret "dns-default-metrics-tls" not found Jul 08 00:10:52.377264 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:52.377232 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hf9ls" event={"ID":"ae381675-5fa6-47a9-a96b-e5dfbded8015","Type":"ContainerStarted","Data":"26ef9a44bbcaacf01354420110fe269889c442c9345821ec934bfb68660bf099"} Jul 08 00:10:52.393381 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:52.393329 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-hf9ls" podStartSLOduration=2.259815023 podStartE2EDuration="4.393308993s" totalImagesPullingTime="2.13349397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:10:52.392297751 +0000 UTC m=+54.871143007" watchObservedRunningTime="2026-07-08 00:10:52.393308993 +0000 UTC m=+54.872154226" Jul 08 00:10:52.861942 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:52.861904 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:53.088263 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:53.088230 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:53.191565 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:53.191458 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:53.290135 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:53.290082 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:53.390219 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:53.390189 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:53.577286 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:53.577253 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:53.742715 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:53.742678 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:53.742876 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:53.742728 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:10:53.742876 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:53.742825 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 00:10:53.742876 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:53.742833 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 00:10:53.742876 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:53.742876 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:11:01.742863365 +0000 UTC m=+64.221708601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : secret "insights-runtime-extractor-tls" not found Jul 08 00:10:53.743012 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:10:53.742900 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:11:01.742881346 +0000 UTC m=+64.221726593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : configmap "kube-rbac-proxy" not found Jul 08 00:10:54.564414 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:54.564381 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:54.959577 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:54.959486 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:55.180927 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:55.180896 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:55.358054 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:55.358023 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:55.752152 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:55.752061 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:56.564293 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:56.564260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:56.664728 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:56.664699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:56.798940 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:56.798910 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:57.052876 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:57.052847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:57.359347 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:57.359256 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:57.459951 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:57.459920 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:58.161622 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:58.161589 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:58.559644 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:58.559613 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:58.761348 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:58.761314 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:58.861670 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:58.861589 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:58.913048 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:58.913023 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:58.961816 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:58.961779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:59.149769 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:59.149687 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:59.250993 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:59.250965 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:59.359133 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:59.359083 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:10:59.959686 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:10:59.959654 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:00.366177 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:00.366150 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:00.417335 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:00.417302 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:00.764634 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:00.764554 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:00.959491 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:00.959455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:01.332413 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:01.332384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:01.387792 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:01.387762 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:01.807596 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:01.807562 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:11:01.807746 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:01.807615 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:11:01.807746 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:11:01.807732 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 00:11:01.807819 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:11:01.807800 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls podName:8e2a553f-466a-48c0-a8ed-23e1b790212e nodeName:}" failed. No retries permitted until 2026-07-08 00:11:17.807780367 +0000 UTC m=+80.286625598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ns4jb" (UID: "8e2a553f-466a-48c0-a8ed-23e1b790212e") : secret "insights-runtime-extractor-tls" not found Jul 08 00:11:01.808130 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:01.808092 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e2a553f-466a-48c0-a8ed-23e1b790212e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:11:01.968717 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:01.968680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:02.323644 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.323618 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zqqsq" Jul 08 00:11:02.363520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.363482 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:02.557319 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.557285 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:02.815597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.815563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:11:02.815752 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.815638 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:11:02.815752 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.815670 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:11:02.818380 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.818359 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 00:11:02.818380 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.818374 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 00:11:02.818548 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.818485 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 00:11:02.827931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.827908 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3a86c6-12ef-4400-9c85-1263f4a7d02b-metrics-certs\") pod \"network-metrics-daemon-qv87q\" (UID: \"ab3a86c6-12ef-4400-9c85-1263f4a7d02b\") " pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:11:02.828037 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.827945 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e922c6d7-2a40-42a4-9940-6e18dcf34f88-original-pull-secret\") pod \"global-pull-secret-syncer-gxr69\" (UID: \"e922c6d7-2a40-42a4-9940-6e18dcf34f88\") " pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:11:02.828199 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.828183 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 00:11:02.838352 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.838332 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz8sh\" (UniqueName: \"kubernetes.io/projected/1234d087-10b5-4aa2-85c0-1ba9291db5f0-kube-api-access-jz8sh\") pod \"network-check-target-rztbr\" (UID: \"1234d087-10b5-4aa2-85c0-1ba9291db5f0\") " pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:11:02.955788 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:02.955747 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:03.026378 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.026347 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-czrvf\"" Jul 08 00:11:03.030813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.030790 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gxr69" Jul 08 00:11:03.034451 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.034434 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:11:03.040752 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.040731 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kstgw\"" Jul 08 00:11:03.048278 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.048255 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qv87q" Jul 08 00:11:03.170316 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.170258 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gxr69"] Jul 08 00:11:03.177189 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:03.176832 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode922c6d7_2a40_42a4_9940_6e18dcf34f88.slice/crio-eb396f118c82e9afc25b96da2883d4238b5fffcbb26ba5d560342b8959cd64e3 WatchSource:0}: Error finding container eb396f118c82e9afc25b96da2883d4238b5fffcbb26ba5d560342b8959cd64e3: Status 404 returned error can't find the container with id eb396f118c82e9afc25b96da2883d4238b5fffcbb26ba5d560342b8959cd64e3 Jul 08 00:11:03.190289 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.190258 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rztbr"] Jul 08 00:11:03.192878 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:03.192851 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1234d087_10b5_4aa2_85c0_1ba9291db5f0.slice/crio-98f3eb9633d84fc3d09e35528964e5d27420782a01b3b71567533d57597bb65a WatchSource:0}: Error finding container 98f3eb9633d84fc3d09e35528964e5d27420782a01b3b71567533d57597bb65a: Status 404 returned error can't find the container with id 98f3eb9633d84fc3d09e35528964e5d27420782a01b3b71567533d57597bb65a Jul 08 00:11:03.205705 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.205679 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qv87q"] Jul 08 00:11:03.209507 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:03.209482 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3a86c6_12ef_4400_9c85_1263f4a7d02b.slice/crio-17eaf02d249d5b3b9241b8be179e59c4fbb546bdc7d6ee630688c2a968429400 WatchSource:0}: Error finding container 17eaf02d249d5b3b9241b8be179e59c4fbb546bdc7d6ee630688c2a968429400: Status 404 returned error can't find the container with id 17eaf02d249d5b3b9241b8be179e59c4fbb546bdc7d6ee630688c2a968429400 Jul 08 00:11:03.354670 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.354581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:03.406331 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.406294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qv87q" event={"ID":"ab3a86c6-12ef-4400-9c85-1263f4a7d02b","Type":"ContainerStarted","Data":"17eaf02d249d5b3b9241b8be179e59c4fbb546bdc7d6ee630688c2a968429400"} Jul 08 00:11:03.407378 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.407342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gxr69" event={"ID":"e922c6d7-2a40-42a4-9940-6e18dcf34f88","Type":"ContainerStarted","Data":"eb396f118c82e9afc25b96da2883d4238b5fffcbb26ba5d560342b8959cd64e3"} Jul 08 00:11:03.408380 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.408362 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rztbr" event={"ID":"1234d087-10b5-4aa2-85c0-1ba9291db5f0","Type":"ContainerStarted","Data":"98f3eb9633d84fc3d09e35528964e5d27420782a01b3b71567533d57597bb65a"} Jul 08 00:11:03.560469 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:03.560436 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:05.417244 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:05.417210 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qv87q" event={"ID":"ab3a86c6-12ef-4400-9c85-1263f4a7d02b","Type":"ContainerStarted","Data":"286318585e83a571daff6c29ead761c8cfb66c0f8bdf3c356eee795e38affa66"} Jul 08 00:11:05.417651 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:05.417270 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qv87q" event={"ID":"ab3a86c6-12ef-4400-9c85-1263f4a7d02b","Type":"ContainerStarted","Data":"875eb4271e65f7c0b6581491260707aa8414d8f1ff985154c713b0aec07895d8"} Jul 08 00:11:05.434630 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:05.434567 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qv87q" podStartSLOduration=65.932639447 podStartE2EDuration="1m7.434545768s" totalImagesPullingTime="1.501906321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:05.433516787 +0000 UTC m=+67.912362042" watchObservedRunningTime="2026-07-08 00:11:05.434545768 +0000 UTC m=+67.913391024" Jul 08 00:11:07.428022 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:07.427981 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rztbr" event={"ID":"1234d087-10b5-4aa2-85c0-1ba9291db5f0","Type":"ContainerStarted","Data":"067f67a0acc673a9fe511d1e3b426cf0748f92403c54c67fbe1775f54c49f7ae"} Jul 08 00:11:07.428508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:07.428128 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:11:07.445399 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:07.445343 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rztbr" podStartSLOduration=65.992028811 podStartE2EDuration="1m9.445325364s" totalImagesPullingTime="3.453296553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:07.444213386 +0000 UTC m=+69.923058641" watchObservedRunningTime="2026-07-08 00:11:07.445325364 +0000 UTC m=+69.924170618" Jul 08 00:11:08.258458 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.258418 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:11:08.258650 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.258521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:11:08.261137 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.261110 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"image-registry-6c85668cb9-h9w6p\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:11:08.261265 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.261220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1-metrics-tls\") pod \"dns-default-m8jbt\" (UID: \"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1\") " pod="openshift-dns/dns-default-m8jbt" Jul 08 00:11:08.424638 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.424603 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c85668cb9-h9w6p"] Jul 08 00:11:08.427654 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.427630 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8jfk\"" Jul 08 00:11:08.435637 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.435616 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:11:08.448112 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.448074 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:08.471763 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.471731 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f578dfc4c-lt9hs"] Jul 08 00:11:08.474059 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.474039 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.491088 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.491065 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f578dfc4c-lt9hs"] Jul 08 00:11:08.535975 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.535945 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kx7hf\"" Jul 08 00:11:08.544192 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.544164 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8jbt" Jul 08 00:11:08.550447 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.550415 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:08.560403 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.560382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/987a406c-c130-4cfe-a852-d5909b3b661e-registry-tls\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.560529 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.560412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/987a406c-c130-4cfe-a852-d5909b3b661e-registry-certificates\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.560529 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.560452 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/987a406c-c130-4cfe-a852-d5909b3b661e-bound-sa-token\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.560529 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.560497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb5wv\" (UniqueName: \"kubernetes.io/projected/987a406c-c130-4cfe-a852-d5909b3b661e-kube-api-access-hb5wv\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.560683 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.560555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/987a406c-c130-4cfe-a852-d5909b3b661e-installation-pull-secrets\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.560683 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.560599 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/987a406c-c130-4cfe-a852-d5909b3b661e-image-registry-private-configuration\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.560683 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.560634 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/987a406c-c130-4cfe-a852-d5909b3b661e-ca-trust-extracted\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.560683 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.560652 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/987a406c-c130-4cfe-a852-d5909b3b661e-trusted-ca\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.661308 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.661267 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/987a406c-c130-4cfe-a852-d5909b3b661e-registry-certificates\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.661502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.661332 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/987a406c-c130-4cfe-a852-d5909b3b661e-bound-sa-token\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.661502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.661366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb5wv\" (UniqueName: \"kubernetes.io/projected/987a406c-c130-4cfe-a852-d5909b3b661e-kube-api-access-hb5wv\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.661502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.661425 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/987a406c-c130-4cfe-a852-d5909b3b661e-installation-pull-secrets\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.661502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.661465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/987a406c-c130-4cfe-a852-d5909b3b661e-image-registry-private-configuration\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.661502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.661497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/987a406c-c130-4cfe-a852-d5909b3b661e-ca-trust-extracted\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.661784 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.661520 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/987a406c-c130-4cfe-a852-d5909b3b661e-trusted-ca\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.661784 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.661571 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/987a406c-c130-4cfe-a852-d5909b3b661e-registry-tls\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.662149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.662119 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/987a406c-c130-4cfe-a852-d5909b3b661e-ca-trust-extracted\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.662282 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.662262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/987a406c-c130-4cfe-a852-d5909b3b661e-registry-certificates\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.662894 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.662840 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/987a406c-c130-4cfe-a852-d5909b3b661e-trusted-ca\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.663003 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.662938 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:08.664570 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.664545 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/987a406c-c130-4cfe-a852-d5909b3b661e-image-registry-private-configuration\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.664668 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.664570 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/987a406c-c130-4cfe-a852-d5909b3b661e-registry-tls\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.664758 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.664657 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/987a406c-c130-4cfe-a852-d5909b3b661e-installation-pull-secrets\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.677581 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.677550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/987a406c-c130-4cfe-a852-d5909b3b661e-bound-sa-token\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.677721 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.677672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb5wv\" (UniqueName: \"kubernetes.io/projected/987a406c-c130-4cfe-a852-d5909b3b661e-kube-api-access-hb5wv\") pod \"image-registry-5f578dfc4c-lt9hs\" (UID: \"987a406c-c130-4cfe-a852-d5909b3b661e\") " pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.748677 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.748625 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:08.785175 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.785124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:08.805751 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.805690 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-928fx"] Jul 08 00:11:08.812308 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.812261 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-928fx" Jul 08 00:11:08.823977 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.818181 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 00:11:08.823977 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.818727 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lbk5m\"" Jul 08 00:11:08.823977 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.821480 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-928fx"] Jul 08 00:11:08.824937 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.824653 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 00:11:08.830604 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.830551 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:08.864219 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.864020 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngws8\" (UniqueName: \"kubernetes.io/projected/df08d306-167b-4e1c-a522-215c079c4793-kube-api-access-ngws8\") pod \"downloads-685bfb5f64-928fx\" (UID: \"df08d306-167b-4e1c-a522-215c079c4793\") " pod="openshift-console/downloads-685bfb5f64-928fx" Jul 08 00:11:08.876596 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.876557 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c85668cb9-h9w6p"] Jul 08 00:11:08.880751 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:08.880716 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5a17a0_6cef_46f5_9a41_fa73b1ed7a04.slice/crio-4a93f2f55411521d95b5ba7c2eeb5d0ef4e55eb6c8a73079c8f912503b4c3c3e WatchSource:0}: Error finding container 4a93f2f55411521d95b5ba7c2eeb5d0ef4e55eb6c8a73079c8f912503b4c3c3e: Status 404 returned error can't find the container with id 4a93f2f55411521d95b5ba7c2eeb5d0ef4e55eb6c8a73079c8f912503b4c3c3e Jul 08 00:11:08.886527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.886503 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8jbt"] Jul 08 00:11:08.889820 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:08.889792 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54be54e_8d3e_4cc2_b34f_3f7a06b0d3e1.slice/crio-5c458c0231ca4af0864c97bd054fd719febe10e017462fa1c3e3acd813953ad7 WatchSource:0}: Error finding container 5c458c0231ca4af0864c97bd054fd719febe10e017462fa1c3e3acd813953ad7: Status 404 returned error can't find the container with id 5c458c0231ca4af0864c97bd054fd719febe10e017462fa1c3e3acd813953ad7 Jul 08 00:11:08.904057 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.903985 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:08.951878 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.951836 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f578dfc4c-lt9hs"] Jul 08 00:11:08.956544 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:08.956515 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987a406c_c130_4cfe_a852_d5909b3b661e.slice/crio-45728b6f042b275f471a2c2765dc053d737d1cedb6719208255fbbd50cdd7944 WatchSource:0}: Error finding container 45728b6f042b275f471a2c2765dc053d737d1cedb6719208255fbbd50cdd7944: Status 404 returned error can't find the container with id 45728b6f042b275f471a2c2765dc053d737d1cedb6719208255fbbd50cdd7944 Jul 08 00:11:08.965272 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.965244 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngws8\" (UniqueName: \"kubernetes.io/projected/df08d306-167b-4e1c-a522-215c079c4793-kube-api-access-ngws8\") pod \"downloads-685bfb5f64-928fx\" (UID: \"df08d306-167b-4e1c-a522-215c079c4793\") " pod="openshift-console/downloads-685bfb5f64-928fx" Jul 08 00:11:08.979962 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:08.979937 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngws8\" (UniqueName: \"kubernetes.io/projected/df08d306-167b-4e1c-a522-215c079c4793-kube-api-access-ngws8\") pod \"downloads-685bfb5f64-928fx\" (UID: \"df08d306-167b-4e1c-a522-215c079c4793\") " pod="openshift-console/downloads-685bfb5f64-928fx" Jul 08 00:11:09.095806 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.095704 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:09.127767 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.127724 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-928fx" Jul 08 00:11:09.276418 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.276338 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:09.276418 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.276353 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-928fx"] Jul 08 00:11:09.281789 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:09.281759 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf08d306_167b_4e1c_a522_215c079c4793.slice/crio-bfbbf992742f599263bbf1d23ecd0dd3c309eb33a3d57ea5536984ae97110cbe WatchSource:0}: Error finding container bfbbf992742f599263bbf1d23ecd0dd3c309eb33a3d57ea5536984ae97110cbe: Status 404 returned error can't find the container with id bfbbf992742f599263bbf1d23ecd0dd3c309eb33a3d57ea5536984ae97110cbe Jul 08 00:11:09.374760 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.374677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:09.437280 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.437144 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" event={"ID":"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04","Type":"ContainerStarted","Data":"cdb08234c5085ad3f2588de865f10aea5715fb4fe6e9bec075c26665d8847684"} Jul 08 00:11:09.437280 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.437217 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:11:09.437280 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.437240 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" event={"ID":"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04","Type":"ContainerStarted","Data":"4a93f2f55411521d95b5ba7c2eeb5d0ef4e55eb6c8a73079c8f912503b4c3c3e"} Jul 08 00:11:09.439044 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.439000 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gxr69" event={"ID":"e922c6d7-2a40-42a4-9940-6e18dcf34f88","Type":"ContainerStarted","Data":"f8e189288ce1c263608cf0a2287ae9cf8279fd1a6b96edfc30975f887eb449ab"} Jul 08 00:11:09.440549 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.440521 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-928fx" event={"ID":"df08d306-167b-4e1c-a522-215c079c4793","Type":"ContainerStarted","Data":"bfbbf992742f599263bbf1d23ecd0dd3c309eb33a3d57ea5536984ae97110cbe"} Jul 08 00:11:09.442437 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.442405 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" event={"ID":"987a406c-c130-4cfe-a852-d5909b3b661e","Type":"ContainerStarted","Data":"dbb9e4fda53e43103905bf7cb4e94414b9f1c5c31915feb7944415643c57298b"} Jul 08 00:11:09.442523 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.442455 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" event={"ID":"987a406c-c130-4cfe-a852-d5909b3b661e","Type":"ContainerStarted","Data":"45728b6f042b275f471a2c2765dc053d737d1cedb6719208255fbbd50cdd7944"} Jul 08 00:11:09.442587 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.442581 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:09.443756 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.443732 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8jbt" event={"ID":"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1","Type":"ContainerStarted","Data":"5c458c0231ca4af0864c97bd054fd719febe10e017462fa1c3e3acd813953ad7"} Jul 08 00:11:09.456176 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.455952 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" podStartSLOduration=38.455937273 podStartE2EDuration="38.455937273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:10:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:09.45507758 +0000 UTC m=+71.933922858" watchObservedRunningTime="2026-07-08 00:11:09.455937273 +0000 UTC m=+71.934782527" Jul 08 00:11:09.460541 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.460466 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:09.494068 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.494018 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gxr69" podStartSLOduration=65.872831337 podStartE2EDuration="1m11.494003778s" totalImagesPullingTime="5.621172441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:09.470962123 +0000 UTC m=+71.949807377" watchObservedRunningTime="2026-07-08 00:11:09.494003778 +0000 UTC m=+71.972849013" Jul 08 00:11:09.494419 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.494392 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" podStartSLOduration=1.49438519 podStartE2EDuration="1.49438519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:11:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:09.493191693 +0000 UTC m=+71.972036948" watchObservedRunningTime="2026-07-08 00:11:09.49438519 +0000 UTC m=+71.973230456" Jul 08 00:11:09.670053 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.669972 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:09.772192 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.772161 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:09.872622 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.872585 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:09.973568 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:09.973490 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:10.115521 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:10.115486 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:10.300395 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:10.300358 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:10.497511 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:10.497479 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:10.598647 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:10.598561 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:10.905230 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:10.905152 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:11.005607 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:11.005578 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:11.106111 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:11.106060 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:11.458129 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:11.458032 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8jbt" event={"ID":"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1","Type":"ContainerStarted","Data":"23326cedf9b73a2d4493bd82df1c00aa2e6baee014f54a8a0a80aa816205755c"} Jul 08 00:11:11.458285 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:11.458144 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m8jbt" Jul 08 00:11:11.458285 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:11.458176 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8jbt" event={"ID":"d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1","Type":"ContainerStarted","Data":"f949405379a44bc88a7fc9b4aa401cf8715abf66fad636d6d8896bb5b2f3bfb3"} Jul 08 00:11:11.476523 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:11.476231 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m8jbt" podStartSLOduration=33.456210695 podStartE2EDuration="35.47621183s" totalImagesPullingTime="2.020001135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:11.475674991 +0000 UTC m=+73.954520244" watchObservedRunningTime="2026-07-08 00:11:11.47621183 +0000 UTC m=+73.955057086" Jul 08 00:11:12.507606 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:12.507564 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:13.133147 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.133106 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:13.181863 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.181816 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:13.252565 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.252530 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:13.267909 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.267876 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn"] Jul 08 00:11:13.270041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.270025 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" Jul 08 00:11:13.272508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.272486 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 00:11:13.272614 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.272494 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d4skx\"" Jul 08 00:11:13.277800 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.277777 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn"] Jul 08 00:11:13.300169 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.300139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/83399d8c-b35b-4557-b7e6-8927a8c87ddb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-86pfn\" (UID: \"83399d8c-b35b-4557-b7e6-8927a8c87ddb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" Jul 08 00:11:13.401245 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.401164 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/83399d8c-b35b-4557-b7e6-8927a8c87ddb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-86pfn\" (UID: \"83399d8c-b35b-4557-b7e6-8927a8c87ddb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" Jul 08 00:11:13.404060 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.404001 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/83399d8c-b35b-4557-b7e6-8927a8c87ddb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-86pfn\" (UID: \"83399d8c-b35b-4557-b7e6-8927a8c87ddb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" Jul 08 00:11:13.434895 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.434857 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:13.580021 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.579988 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" Jul 08 00:11:13.719849 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:13.719816 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn"] Jul 08 00:11:13.723371 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:13.723324 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83399d8c_b35b_4557_b7e6_8927a8c87ddb.slice/crio-23c52bddc29ee192b3bded5a723999728a2393db57f630266676490189068923 WatchSource:0}: Error finding container 23c52bddc29ee192b3bded5a723999728a2393db57f630266676490189068923: Status 404 returned error can't find the container with id 23c52bddc29ee192b3bded5a723999728a2393db57f630266676490189068923 Jul 08 00:11:14.186643 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:14.186608 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:14.287716 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:14.287684 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:14.470795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:14.470701 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" event={"ID":"83399d8c-b35b-4557-b7e6-8927a8c87ddb","Type":"ContainerStarted","Data":"23c52bddc29ee192b3bded5a723999728a2393db57f630266676490189068923"} Jul 08 00:11:15.476229 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:15.476139 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" event={"ID":"83399d8c-b35b-4557-b7e6-8927a8c87ddb","Type":"ContainerStarted","Data":"2370cabb4c1cb4c0769a32b6cbf66bd6d3786628a1fdfe6de37a4936d1fac5c9"} Jul 08 00:11:15.476643 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:15.476314 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" Jul 08 00:11:15.482051 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:15.482028 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" Jul 08 00:11:15.493402 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:15.493359 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-86pfn" podStartSLOduration=1.123894933 podStartE2EDuration="2.49334436s" totalImagesPullingTime="1.369449427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:15.491420999 +0000 UTC m=+77.970266255" watchObservedRunningTime="2026-07-08 00:11:15.49334436 +0000 UTC m=+77.972189614" Jul 08 00:11:16.180947 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.180905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:16.283545 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.283507 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:16.331261 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.331231 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-946lx"] Jul 08 00:11:16.333486 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.333464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.336903 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.336878 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 00:11:16.337016 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.336880 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 00:11:16.337782 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.337763 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 00:11:16.337891 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.337768 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rw57s\"" Jul 08 00:11:16.338295 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.338273 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 00:11:16.338295 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.338273 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 00:11:16.346143 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.346121 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-946lx"] Jul 08 00:11:16.352302 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.352279 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:16.426717 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.426685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6d301d8-9885-4c65-996c-9e67e7c6f669-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.426890 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.426727 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n68hh\" (UniqueName: \"kubernetes.io/projected/b6d301d8-9885-4c65-996c-9e67e7c6f669-kube-api-access-n68hh\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.426890 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.426841 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6d301d8-9885-4c65-996c-9e67e7c6f669-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.427000 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.426937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6d301d8-9885-4c65-996c-9e67e7c6f669-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.486184 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.486106 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:16.527769 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.527731 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6d301d8-9885-4c65-996c-9e67e7c6f669-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.527769 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.527772 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6d301d8-9885-4c65-996c-9e67e7c6f669-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.528027 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.527794 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n68hh\" (UniqueName: \"kubernetes.io/projected/b6d301d8-9885-4c65-996c-9e67e7c6f669-kube-api-access-n68hh\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.528027 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.527828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6d301d8-9885-4c65-996c-9e67e7c6f669-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.528459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.528432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6d301d8-9885-4c65-996c-9e67e7c6f669-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.530213 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.530192 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6d301d8-9885-4c65-996c-9e67e7c6f669-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.530313 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.530270 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b6d301d8-9885-4c65-996c-9e67e7c6f669-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.535398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.535375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n68hh\" (UniqueName: \"kubernetes.io/projected/b6d301d8-9885-4c65-996c-9e67e7c6f669-kube-api-access-n68hh\") pod \"prometheus-operator-567f7b8b7c-946lx\" (UID: \"b6d301d8-9885-4c65-996c-9e67e7c6f669\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.619391 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.619343 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:16.644431 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.644402 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" Jul 08 00:11:16.715208 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.715140 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:16.781967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:16.781838 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-946lx"] Jul 08 00:11:16.784777 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:16.784749 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d301d8_9885_4c65_996c_9e67e7c6f669.slice/crio-8bf28e9683dbae969d6a6ad4e7ac90ccf06fcc390c4948b2fcf80a273b0d432b WatchSource:0}: Error finding container 8bf28e9683dbae969d6a6ad4e7ac90ccf06fcc390c4948b2fcf80a273b0d432b: Status 404 returned error can't find the container with id 8bf28e9683dbae969d6a6ad4e7ac90ccf06fcc390c4948b2fcf80a273b0d432b Jul 08 00:11:17.485296 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.485254 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" event={"ID":"b6d301d8-9885-4c65-996c-9e67e7c6f669","Type":"ContainerStarted","Data":"8bf28e9683dbae969d6a6ad4e7ac90ccf06fcc390c4948b2fcf80a273b0d432b"} Jul 08 00:11:17.837379 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.837345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:11:17.839976 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.839939 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e2a553f-466a-48c0-a8ed-23e1b790212e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ns4jb\" (UID: \"8e2a553f-466a-48c0-a8ed-23e1b790212e\") " pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:11:17.920208 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.920169 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79655f7bfd-x67th"] Jul 08 00:11:17.922472 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.922450 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:17.926978 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.926764 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8vrqt\"" Jul 08 00:11:17.926978 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.926804 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 00:11:17.926978 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.926831 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 00:11:17.927250 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.927056 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 00:11:17.927311 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.927257 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 00:11:17.927425 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.927398 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 00:11:17.933788 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:17.933761 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79655f7bfd-x67th"] Jul 08 00:11:18.038707 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.038677 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8tk2\" (UniqueName: \"kubernetes.io/projected/398f1991-e534-4249-a9d3-5c6f2fc99040-kube-api-access-g8tk2\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.038889 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.038720 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-service-ca\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.038889 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.038760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-console-config\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.038889 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.038812 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-oauth-serving-cert\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.039075 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.038890 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-oauth-config\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.039075 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.038918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-serving-cert\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.073758 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.073722 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ksrf\"" Jul 08 00:11:18.082190 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.082158 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ns4jb" Jul 08 00:11:18.139480 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.139384 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8tk2\" (UniqueName: \"kubernetes.io/projected/398f1991-e534-4249-a9d3-5c6f2fc99040-kube-api-access-g8tk2\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.139480 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.139427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-service-ca\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.139480 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.139471 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-console-config\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.139766 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.139506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-oauth-serving-cert\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.139766 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.139558 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-oauth-config\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.139766 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.139581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-serving-cert\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.140357 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.140323 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-service-ca\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.140481 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.140443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-oauth-serving-cert\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.140649 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.140624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-console-config\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.142637 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.142616 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-oauth-config\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.142758 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.142722 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-serving-cert\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.148973 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.148940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8tk2\" (UniqueName: \"kubernetes.io/projected/398f1991-e534-4249-a9d3-5c6f2fc99040-kube-api-access-g8tk2\") pod \"console-79655f7bfd-x67th\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.234279 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.234236 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:18.457355 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.457315 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ns4jb"] Jul 08 00:11:18.461651 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:18.461621 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2a553f_466a_48c0_a8ed_23e1b790212e.slice/crio-5630b72cc4fe4acd1e6da26ea983067d802ef84912c68dbfdcfeefc3bd9c9d66 WatchSource:0}: Error finding container 5630b72cc4fe4acd1e6da26ea983067d802ef84912c68dbfdcfeefc3bd9c9d66: Status 404 returned error can't find the container with id 5630b72cc4fe4acd1e6da26ea983067d802ef84912c68dbfdcfeefc3bd9c9d66 Jul 08 00:11:18.477004 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.476977 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79655f7bfd-x67th"] Jul 08 00:11:18.480346 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:18.480316 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398f1991_e534_4249_a9d3_5c6f2fc99040.slice/crio-778386c4c6bbe2fd8823d49571a1a3c4d7debe5c2e844e0b34474853a8bb6a9b WatchSource:0}: Error finding container 778386c4c6bbe2fd8823d49571a1a3c4d7debe5c2e844e0b34474853a8bb6a9b: Status 404 returned error can't find the container with id 778386c4c6bbe2fd8823d49571a1a3c4d7debe5c2e844e0b34474853a8bb6a9b Jul 08 00:11:18.491074 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.491040 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79655f7bfd-x67th" event={"ID":"398f1991-e534-4249-a9d3-5c6f2fc99040","Type":"ContainerStarted","Data":"778386c4c6bbe2fd8823d49571a1a3c4d7debe5c2e844e0b34474853a8bb6a9b"} Jul 08 00:11:18.492416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.492391 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ns4jb" event={"ID":"8e2a553f-466a-48c0-a8ed-23e1b790212e","Type":"ContainerStarted","Data":"5630b72cc4fe4acd1e6da26ea983067d802ef84912c68dbfdcfeefc3bd9c9d66"} Jul 08 00:11:18.494976 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.494947 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" event={"ID":"b6d301d8-9885-4c65-996c-9e67e7c6f669","Type":"ContainerStarted","Data":"6854cddf502457e6fb516d2d381cadbd6a2f21a46bdab9140ee0aa59286d8229"} Jul 08 00:11:18.495174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.495003 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" event={"ID":"b6d301d8-9885-4c65-996c-9e67e7c6f669","Type":"ContainerStarted","Data":"20c0cac13188e98e6835bb0347adae9660208c86805a6ec9d47c1138a439bcea"} Jul 08 00:11:18.511555 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.511496 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-946lx" podStartSLOduration=0.959756659 podStartE2EDuration="2.511479576s" totalImagesPullingTime="1.551722917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:18.51011943 +0000 UTC m=+80.988964718" watchObservedRunningTime="2026-07-08 00:11:18.511479576 +0000 UTC m=+80.990324830" Jul 08 00:11:18.600632 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:18.600603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:19.658861 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:19.658433 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:19.758960 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:19.758877 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:20.454442 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.454349 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:20.679458 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.679384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:20.719626 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.719530 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9jzzk"] Jul 08 00:11:20.729604 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.729471 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.733808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.733313 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 00:11:20.733808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.733360 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ggcnt\"" Jul 08 00:11:20.733808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.733418 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 00:11:20.733808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.733314 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 00:11:20.765430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.764987 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.765430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.765032 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-textfile\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.765430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.765081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-accelerators-collector-config\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.765430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.765128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/773dac9c-8211-4e49-91ec-254c1d120af3-root\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.765430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.765167 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-wtmp\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.765430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.765213 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp44m\" (UniqueName: \"kubernetes.io/projected/773dac9c-8211-4e49-91ec-254c1d120af3-kube-api-access-vp44m\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.765430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.765244 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/773dac9c-8211-4e49-91ec-254c1d120af3-sys\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.765430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.765281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/773dac9c-8211-4e49-91ec-254c1d120af3-metrics-client-ca\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.765430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.765303 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-tls\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.772355 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.772278 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:20.856115 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.853856 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871435 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-wtmp\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp44m\" (UniqueName: \"kubernetes.io/projected/773dac9c-8211-4e49-91ec-254c1d120af3-kube-api-access-vp44m\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871522 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/773dac9c-8211-4e49-91ec-254c1d120af3-sys\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871556 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/773dac9c-8211-4e49-91ec-254c1d120af3-metrics-client-ca\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-tls\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871608 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871638 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-textfile\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871681 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-accelerators-collector-config\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/773dac9c-8211-4e49-91ec-254c1d120af3-root\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871756 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-wtmp\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.871984 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.871781 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/773dac9c-8211-4e49-91ec-254c1d120af3-root\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.872646 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.872026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/773dac9c-8211-4e49-91ec-254c1d120af3-sys\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.872646 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.872045 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-textfile\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.872646 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:11:20.872158 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 00:11:20.872646 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:11:20.872216 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-tls podName:773dac9c-8211-4e49-91ec-254c1d120af3 nodeName:}" failed. No retries permitted until 2026-07-08 00:11:21.372196922 +0000 UTC m=+83.851042155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-tls") pod "node-exporter-9jzzk" (UID: "773dac9c-8211-4e49-91ec-254c1d120af3") : secret "node-exporter-tls" not found Jul 08 00:11:20.872646 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.872219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/773dac9c-8211-4e49-91ec-254c1d120af3-metrics-client-ca\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.872646 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.872491 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-accelerators-collector-config\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.885083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.885005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.887193 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.887165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp44m\" (UniqueName: \"kubernetes.io/projected/773dac9c-8211-4e49-91ec-254c1d120af3-kube-api-access-vp44m\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:20.953560 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:20.953440 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:21.052316 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.051683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:21.155295 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.155254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:21.258160 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.258110 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:21.353510 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.353370 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:21.376737 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.376685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-tls\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:21.379552 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.379522 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/773dac9c-8211-4e49-91ec-254c1d120af3-node-exporter-tls\") pod \"node-exporter-9jzzk\" (UID: \"773dac9c-8211-4e49-91ec-254c1d120af3\") " pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:21.464593 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.464565 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m8jbt" Jul 08 00:11:21.646169 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.646012 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9jzzk" Jul 08 00:11:21.691175 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.691135 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:21.784614 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.784581 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 00:11:21.787642 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.787605 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:21.790652 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.790495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.793353 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.793331 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 00:11:21.793876 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.793801 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 00:11:21.793876 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.793870 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 00:11:21.794041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.793801 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gfw24\"" Jul 08 00:11:21.794041 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.793800 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 00:11:21.794343 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.794321 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 00:11:21.794444 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.794360 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 00:11:21.794444 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.794402 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 00:11:21.794444 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.794408 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 00:11:21.794920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.794897 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 00:11:21.808458 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.808431 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 00:11:21.882078 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882036 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882281 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882114 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882281 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882204 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-config-out\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882281 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882253 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882441 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882297 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-config-volume\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882441 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-web-config\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882441 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882363 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882441 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjfbx\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-kube-api-access-tjfbx\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882441 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.882671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.882623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.984645 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.984645 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.984849 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.984849 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-config-out\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.984849 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984717 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.984849 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-config-volume\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.984849 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-web-config\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.984849 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.985091 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjfbx\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-kube-api-access-tjfbx\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.985091 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984880 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.985091 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.985091 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.985091 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.984988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.988046 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.987694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.988046 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:11:21.987773 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-trusted-ca-bundle podName:1e7fde5f-f929-4035-be64-15f9ead763c4 nodeName:}" failed. No retries permitted until 2026-07-08 00:11:22.487749398 +0000 UTC m=+84.966594634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4") : configmap references non-existent config key: ca-bundle.crt Jul 08 00:11:21.989701 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.988345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.992401 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.992378 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-config-volume\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.992989 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.992945 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.993117 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.993051 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.993656 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.993630 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.993811 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.993788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-config-out\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.994732 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.994689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.995334 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.995308 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-web-config\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.995446 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.995347 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:21.995507 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:21.995474 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:22.008450 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:22.008423 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjfbx\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-kube-api-access-tjfbx\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:22.095660 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:22.095598 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:22.490876 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:22.490845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:22.491849 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:22.491826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:22.704695 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:22.704655 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:11:22.729468 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:22.729382 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:22.829753 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:22.829701 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:23.632758 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:23.632682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:23.713296 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:23.713219 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:23.861713 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:23.861674 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:24.128593 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:24.128559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:24.230177 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:24.230143 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:24.333130 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:24.333079 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:25.307189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.307157 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:25.408591 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.408559 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:25.499565 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.499524 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv"] Jul 08 00:11:25.502765 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.502742 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:25.506360 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.506335 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d7n75\"" Jul 08 00:11:25.506946 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.506929 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 08 00:11:25.521207 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.521183 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv"] Jul 08 00:11:25.542522 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.542495 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:25.619831 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.619698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfwtf\" (UniqueName: \"kubernetes.io/projected/b3173619-4bfe-4aa0-b6d1-ae31945dbc99-kube-api-access-kfwtf\") pod \"monitoring-plugin-d5dcff7cf-svpfv\" (UID: \"b3173619-4bfe-4aa0-b6d1-ae31945dbc99\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:25.619831 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.619801 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3173619-4bfe-4aa0-b6d1-ae31945dbc99-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-svpfv\" (UID: \"b3173619-4bfe-4aa0-b6d1-ae31945dbc99\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:25.619831 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.619817 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:25.720795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.720750 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfwtf\" (UniqueName: \"kubernetes.io/projected/b3173619-4bfe-4aa0-b6d1-ae31945dbc99-kube-api-access-kfwtf\") pod \"monitoring-plugin-d5dcff7cf-svpfv\" (UID: \"b3173619-4bfe-4aa0-b6d1-ae31945dbc99\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:25.720981 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.720877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3173619-4bfe-4aa0-b6d1-ae31945dbc99-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-svpfv\" (UID: \"b3173619-4bfe-4aa0-b6d1-ae31945dbc99\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:25.721050 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:11:25.721007 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 08 00:11:25.721130 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:11:25.721072 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3173619-4bfe-4aa0-b6d1-ae31945dbc99-monitoring-plugin-cert podName:b3173619-4bfe-4aa0-b6d1-ae31945dbc99 nodeName:}" failed. No retries permitted until 2026-07-08 00:11:26.221052676 +0000 UTC m=+88.699897908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b3173619-4bfe-4aa0-b6d1-ae31945dbc99-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-svpfv" (UID: "b3173619-4bfe-4aa0-b6d1-ae31945dbc99") : secret "monitoring-plugin-cert" not found Jul 08 00:11:25.736515 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.736482 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfwtf\" (UniqueName: \"kubernetes.io/projected/b3173619-4bfe-4aa0-b6d1-ae31945dbc99-kube-api-access-kfwtf\") pod \"monitoring-plugin-d5dcff7cf-svpfv\" (UID: \"b3173619-4bfe-4aa0-b6d1-ae31945dbc99\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:25.908205 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.908114 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:25.933718 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.933681 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fbf4988d4-tbt4h"] Jul 08 00:11:25.936554 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.936532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:25.939427 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.939398 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 00:11:25.939670 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.939618 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 00:11:25.939670 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.939640 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 00:11:25.939670 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.939650 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 00:11:25.939670 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.939666 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5hg5x\"" Jul 08 00:11:25.940003 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.939987 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 00:11:25.946444 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.946425 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 00:11:25.951070 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:25.951044 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fbf4988d4-tbt4h"] Jul 08 00:11:26.023171 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.023134 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e1a17e-0bca-4875-9f10-904f1e9e9706-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.023171 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.023178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e1a17e-0bca-4875-9f10-904f1e9e9706-serving-certs-ca-bundle\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.023428 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.023215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-secret-telemeter-client\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.023428 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.023295 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-telemeter-client-tls\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.023428 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.023319 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-federate-client-tls\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.023428 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.023350 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbmjx\" (UniqueName: \"kubernetes.io/projected/03e1a17e-0bca-4875-9f10-904f1e9e9706-kube-api-access-fbmjx\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.023631 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.023451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.023631 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.023581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03e1a17e-0bca-4875-9f10-904f1e9e9706-metrics-client-ca\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.124238 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.124204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e1a17e-0bca-4875-9f10-904f1e9e9706-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.124238 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.124246 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e1a17e-0bca-4875-9f10-904f1e9e9706-serving-certs-ca-bundle\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.124521 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.124277 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-secret-telemeter-client\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.124521 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.124438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-telemeter-client-tls\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.124521 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.124483 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-federate-client-tls\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.124697 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.124523 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbmjx\" (UniqueName: \"kubernetes.io/projected/03e1a17e-0bca-4875-9f10-904f1e9e9706-kube-api-access-fbmjx\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.124697 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.124586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.124697 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.124675 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03e1a17e-0bca-4875-9f10-904f1e9e9706-metrics-client-ca\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.125190 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.125163 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e1a17e-0bca-4875-9f10-904f1e9e9706-serving-certs-ca-bundle\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.125563 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.125514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03e1a17e-0bca-4875-9f10-904f1e9e9706-metrics-client-ca\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.125937 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.125889 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e1a17e-0bca-4875-9f10-904f1e9e9706-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.127447 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.127421 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-secret-telemeter-client\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.127654 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.127615 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-telemeter-client-tls\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.127654 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.127647 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.128135 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.128112 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/03e1a17e-0bca-4875-9f10-904f1e9e9706-federate-client-tls\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.133182 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.133158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbmjx\" (UniqueName: \"kubernetes.io/projected/03e1a17e-0bca-4875-9f10-904f1e9e9706-kube-api-access-fbmjx\") pod \"telemeter-client-fbf4988d4-tbt4h\" (UID: \"03e1a17e-0bca-4875-9f10-904f1e9e9706\") " pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.225477 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.225391 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3173619-4bfe-4aa0-b6d1-ae31945dbc99-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-svpfv\" (UID: \"b3173619-4bfe-4aa0-b6d1-ae31945dbc99\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:26.227962 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.227940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3173619-4bfe-4aa0-b6d1-ae31945dbc99-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-svpfv\" (UID: \"b3173619-4bfe-4aa0-b6d1-ae31945dbc99\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:26.248343 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.248313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" Jul 08 00:11:26.414252 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.414215 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:26.888162 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:26.888072 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:28.764216 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:28.764168 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:29.176600 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:29.176549 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:29.237665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:29.237628 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:29.444027 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:29.443950 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:11:30.330581 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:30.330541 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:30.432464 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:30.432430 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:30.455404 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:30.455365 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f578dfc4c-lt9hs" Jul 08 00:11:30.586203 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:30.586125 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:30.687718 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:30.687688 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:31.075359 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:31.075325 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:31.138536 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:31.138487 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:32.033067 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:32.033019 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773dac9c_8211_4e49_91ec_254c1d120af3.slice/crio-d149dec44c95a529c87d89d3eaf698e2ef01cd9a3f1c35a5aa090777a6f9bd30 WatchSource:0}: Error finding container d149dec44c95a529c87d89d3eaf698e2ef01cd9a3f1c35a5aa090777a6f9bd30: Status 404 returned error can't find the container with id d149dec44c95a529c87d89d3eaf698e2ef01cd9a3f1c35a5aa090777a6f9bd30 Jul 08 00:11:32.213859 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.213823 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 00:11:32.277086 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:32.277047 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7fde5f_f929_4035_be64_15f9ead763c4.slice/crio-4f07f054fb21a1e0e46732e5df1eea7d20edfcded8c5fff018aada0cd843a436 WatchSource:0}: Error finding container 4f07f054fb21a1e0e46732e5df1eea7d20edfcded8c5fff018aada0cd843a436: Status 404 returned error can't find the container with id 4f07f054fb21a1e0e46732e5df1eea7d20edfcded8c5fff018aada0cd843a436 Jul 08 00:11:32.427196 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.427159 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv"] Jul 08 00:11:32.430143 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:32.430089 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3173619_4bfe_4aa0_b6d1_ae31945dbc99.slice/crio-f7dd622bbd5f790231caacfb7beeb512a96dff47a4a73a2f14227cbe42ee4579 WatchSource:0}: Error finding container f7dd622bbd5f790231caacfb7beeb512a96dff47a4a73a2f14227cbe42ee4579: Status 404 returned error can't find the container with id f7dd622bbd5f790231caacfb7beeb512a96dff47a4a73a2f14227cbe42ee4579 Jul 08 00:11:32.434761 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.434738 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fbf4988d4-tbt4h"] Jul 08 00:11:32.437085 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:11:32.437056 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e1a17e_0bca_4875_9f10_904f1e9e9706.slice/crio-f8dd0f775ab4cc9f9e4befda11e954b7eedd82035f92a26f9f20e25dd473734a WatchSource:0}: Error finding container f8dd0f775ab4cc9f9e4befda11e954b7eedd82035f92a26f9f20e25dd473734a: Status 404 returned error can't find the container with id f8dd0f775ab4cc9f9e4befda11e954b7eedd82035f92a26f9f20e25dd473734a Jul 08 00:11:32.559454 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.559405 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79655f7bfd-x67th" event={"ID":"398f1991-e534-4249-a9d3-5c6f2fc99040","Type":"ContainerStarted","Data":"637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405"} Jul 08 00:11:32.574843 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.574803 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-928fx" event={"ID":"df08d306-167b-4e1c-a522-215c079c4793","Type":"ContainerStarted","Data":"55ed5b794bef409de531b8685a71e200b4dc890ad7755288078671ccb203e85a"} Jul 08 00:11:32.575511 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.575486 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-928fx" Jul 08 00:11:32.577962 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.577932 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ns4jb" event={"ID":"8e2a553f-466a-48c0-a8ed-23e1b790212e","Type":"ContainerStarted","Data":"becfddebaa99a8f449c0a43285a2d975bad3f71fc75baa867b712671d550ad5e"} Jul 08 00:11:32.580452 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.580426 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jzzk" event={"ID":"773dac9c-8211-4e49-91ec-254c1d120af3","Type":"ContainerStarted","Data":"d149dec44c95a529c87d89d3eaf698e2ef01cd9a3f1c35a5aa090777a6f9bd30"} Jul 08 00:11:32.582160 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.582134 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerStarted","Data":"4f07f054fb21a1e0e46732e5df1eea7d20edfcded8c5fff018aada0cd843a436"} Jul 08 00:11:32.584002 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.583972 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" event={"ID":"03e1a17e-0bca-4875-9f10-904f1e9e9706","Type":"ContainerStarted","Data":"f8dd0f775ab4cc9f9e4befda11e954b7eedd82035f92a26f9f20e25dd473734a"} Jul 08 00:11:32.585691 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.585662 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-928fx" Jul 08 00:11:32.586248 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.586199 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79655f7bfd-x67th" podStartSLOduration=2.039306382 podStartE2EDuration="15.586181594s" totalImagesPullingTime="13.546875212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:32.585462529 +0000 UTC m=+95.064307785" watchObservedRunningTime="2026-07-08 00:11:32.586181594 +0000 UTC m=+95.065026852" Jul 08 00:11:32.587548 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.587523 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" event={"ID":"b3173619-4bfe-4aa0-b6d1-ae31945dbc99","Type":"ContainerStarted","Data":"f7dd622bbd5f790231caacfb7beeb512a96dff47a4a73a2f14227cbe42ee4579"} Jul 08 00:11:32.623527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:32.623000 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-928fx" podStartSLOduration=1.82104811 podStartE2EDuration="24.622975647s" totalImagesPullingTime="22.801927537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:32.605270456 +0000 UTC m=+95.084115711" watchObservedRunningTime="2026-07-08 00:11:32.622975647 +0000 UTC m=+95.101820883" Jul 08 00:11:34.129851 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:34.129771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:34.181249 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:34.181214 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:34.461613 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:34.461426 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" podUID="2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" containerName="registry" containerID="cri-o://cdb08234c5085ad3f2588de865f10aea5715fb4fe6e9bec075c26665d8847684" gracePeriod=30 Jul 08 00:11:35.606426 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.606392 2573 generic.go:356] "Generic (PLEG): container finished" podID="2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" containerID="cdb08234c5085ad3f2588de865f10aea5715fb4fe6e9bec075c26665d8847684" exitCode=0 Jul 08 00:11:35.606857 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.606475 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" event={"ID":"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04","Type":"ContainerDied","Data":"cdb08234c5085ad3f2588de865f10aea5715fb4fe6e9bec075c26665d8847684"} Jul 08 00:11:35.746212 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.746180 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:11:35.921703 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.921674 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-installation-pull-secrets\") pod \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " Jul 08 00:11:35.921847 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.921715 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-trusted-ca\") pod \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " Jul 08 00:11:35.921847 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.921736 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-image-registry-private-configuration\") pod \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " Jul 08 00:11:35.921847 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.921806 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-certificates\") pod \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " Jul 08 00:11:35.921847 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.921836 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np5xw\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-kube-api-access-np5xw\") pod \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " Jul 08 00:11:35.922050 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.921914 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") pod \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " Jul 08 00:11:35.922050 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.921953 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-bound-sa-token\") pod \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " Jul 08 00:11:35.922050 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.921980 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-ca-trust-extracted\") pod \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\" (UID: \"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04\") " Jul 08 00:11:35.922216 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.922109 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:11:35.922279 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.922217 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-trusted-ca\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:11:35.922331 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.922235 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:11:35.924950 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.924913 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:11:35.925067 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.924919 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:11:35.925187 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.925164 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:11:35.925501 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.925470 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-kube-api-access-np5xw" (OuterVolumeSpecName: "kube-api-access-np5xw") pod "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04"). InnerVolumeSpecName "kube-api-access-np5xw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:11:35.926060 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.926024 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:11:35.933888 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:35.933857 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" (UID: "2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:11:36.022655 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.022621 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-tls\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:11:36.022655 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.022653 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-bound-sa-token\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:11:36.022827 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.022666 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-ca-trust-extracted\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:11:36.022827 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.022680 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-installation-pull-secrets\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:11:36.022827 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.022695 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-image-registry-private-configuration\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:11:36.022827 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.022709 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-registry-certificates\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:11:36.022827 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.022723 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np5xw\" (UniqueName: \"kubernetes.io/projected/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04-kube-api-access-np5xw\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:11:36.126526 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.126015 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79655f7bfd-x67th"] Jul 08 00:11:36.223994 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.223276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:36.542150 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.542055 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:36.597563 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.597477 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:36.614797 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.614747 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" event={"ID":"b3173619-4bfe-4aa0-b6d1-ae31945dbc99","Type":"ContainerStarted","Data":"98ee988a651baade36851b96c31cc7cfdbc58b064a720f6c2a9dc777def7022d"} Jul 08 00:11:36.615968 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.615930 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:36.619434 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.619410 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" Jul 08 00:11:36.619434 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.619424 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c85668cb9-h9w6p" event={"ID":"2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04","Type":"ContainerDied","Data":"4a93f2f55411521d95b5ba7c2eeb5d0ef4e55eb6c8a73079c8f912503b4c3c3e"} Jul 08 00:11:36.619617 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.619468 2573 scope.go:117] "RemoveContainer" containerID="cdb08234c5085ad3f2588de865f10aea5715fb4fe6e9bec075c26665d8847684" Jul 08 00:11:36.622354 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.622305 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" Jul 08 00:11:36.624724 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.624695 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ns4jb" event={"ID":"8e2a553f-466a-48c0-a8ed-23e1b790212e","Type":"ContainerStarted","Data":"66e82fa8442daca613e2c384eb2f6bb3f2833e100f5156231e1a73b62109c6c4"} Jul 08 00:11:36.627950 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.627621 2573 generic.go:356] "Generic (PLEG): container finished" podID="773dac9c-8211-4e49-91ec-254c1d120af3" containerID="d902902c35e04492e423d0b197040251da05ce298a9e121131d2771aa1241b49" exitCode=0 Jul 08 00:11:36.627950 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.627802 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jzzk" event={"ID":"773dac9c-8211-4e49-91ec-254c1d120af3","Type":"ContainerDied","Data":"d902902c35e04492e423d0b197040251da05ce298a9e121131d2771aa1241b49"} Jul 08 00:11:36.630414 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.630390 2573 generic.go:356] "Generic (PLEG): container finished" podID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerID="514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2" exitCode=0 Jul 08 00:11:36.630561 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.630524 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerDied","Data":"514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2"} Jul 08 00:11:36.632087 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.632040 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-svpfv" podStartSLOduration=8.160989178 podStartE2EDuration="11.632023739s" totalImagesPullingTime="3.471034561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:36.631366153 +0000 UTC m=+99.110211407" watchObservedRunningTime="2026-07-08 00:11:36.632023739 +0000 UTC m=+99.110868995" Jul 08 00:11:36.636476 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.636445 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" event={"ID":"03e1a17e-0bca-4875-9f10-904f1e9e9706","Type":"ContainerStarted","Data":"83c59dbb77df2e987e7cd90a2baa3c1f32e7beb59f06455a6059958aba5c18e4"} Jul 08 00:11:36.636656 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.636511 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" event={"ID":"03e1a17e-0bca-4875-9f10-904f1e9e9706","Type":"ContainerStarted","Data":"4aeee1c10a932330978b4472fce14bd724c3e6929d330a5fee58c5b23831c961"} Jul 08 00:11:36.636656 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.636543 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" event={"ID":"03e1a17e-0bca-4875-9f10-904f1e9e9706","Type":"ContainerStarted","Data":"a550d31fbe0af446dfe0412064cd454f41bff68b88c0905b02cbb322a2209711"} Jul 08 00:11:36.647940 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.647839 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c85668cb9-h9w6p"] Jul 08 00:11:36.651302 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.651167 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c85668cb9-h9w6p"] Jul 08 00:11:36.732654 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:36.731266 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fbf4988d4-tbt4h" podStartSLOduration=8.261015662 podStartE2EDuration="11.731245499s" totalImagesPullingTime="3.470229837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:36.705797461 +0000 UTC m=+99.184642719" watchObservedRunningTime="2026-07-08 00:11:36.731245499 +0000 UTC m=+99.210090754" Jul 08 00:11:37.649372 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:37.649325 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jzzk" event={"ID":"773dac9c-8211-4e49-91ec-254c1d120af3","Type":"ContainerStarted","Data":"1de11951f01489de9ef0b06581bd6b4c973b0ed6f0a5a267852615d2e3309c9f"} Jul 08 00:11:37.650059 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:37.649381 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jzzk" event={"ID":"773dac9c-8211-4e49-91ec-254c1d120af3","Type":"ContainerStarted","Data":"a6a8569874796a718c8bfb160a17f9000f1b234b1b93fb3cee0d5e9dc0d6c5e2"} Jul 08 00:11:37.671416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:37.671020 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9jzzk" podStartSLOduration=13.922928889 podStartE2EDuration="17.670999306s" totalImagesPullingTime="3.675656944s" totalInitContainerRuntime="72.413473ms" isStatefulPod=true podCreationTimestamp="2026-07-08 00:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:37.667817254 +0000 UTC m=+100.146662546" watchObservedRunningTime="2026-07-08 00:11:37.670999306 +0000 UTC m=+100.149844561" Jul 08 00:11:38.113462 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:38.113429 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:38.117200 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:38.117161 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" path="/var/lib/kubelet/pods/2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04/volumes" Jul 08 00:11:38.212321 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:38.212283 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:38.235207 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:38.235119 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:11:38.435011 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:38.434799 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rztbr" Jul 08 00:11:38.745270 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:38.745141 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:38.802345 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:38.802309 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:39.593296 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:39.593265 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:39.650967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:39.650930 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:40.665020 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:40.664988 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ns4jb" event={"ID":"8e2a553f-466a-48c0-a8ed-23e1b790212e","Type":"ContainerStarted","Data":"c91cdb1e91ae23c0477a19f2611997bfd9f4b8ee48d66437cf4c5da6c1011068"} Jul 08 00:11:40.667286 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:40.667257 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerStarted","Data":"d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c"} Jul 08 00:11:40.692568 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:40.692480 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ns4jb" podStartSLOduration=34.270997542 podStartE2EDuration="55.692458259s" totalImagesPullingTime="21.421460717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:10:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:40.69172571 +0000 UTC m=+103.170570989" watchObservedRunningTime="2026-07-08 00:11:40.692458259 +0000 UTC m=+103.171303514" Jul 08 00:11:41.673804 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:41.673771 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerStarted","Data":"671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60"} Jul 08 00:11:41.674200 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:41.673835 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerStarted","Data":"3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5"} Jul 08 00:11:41.674200 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:41.673863 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerStarted","Data":"bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625"} Jul 08 00:11:41.674200 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:41.673886 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerStarted","Data":"e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858"} Jul 08 00:11:42.681831 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:42.681797 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerStarted","Data":"b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8"} Jul 08 00:11:42.708043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:42.707993 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=12.88742281 podStartE2EDuration="21.70797224s" totalImagesPullingTime="8.792207853s" totalInitContainerRuntime="28.341577ms" isStatefulPod=false podCreationTimestamp="2026-07-08 00:11:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:11:42.706076126 +0000 UTC m=+105.184921380" watchObservedRunningTime="2026-07-08 00:11:42.70797224 +0000 UTC m=+105.186817494" Jul 08 00:11:44.185219 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:44.185187 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:44.286238 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:44.286203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:49.292572 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:49.292536 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:49.345283 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:49.345254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:49.401294 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:49.401260 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:59.197497 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:59.197462 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:11:59.297502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:11:59.297462 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:01.035300 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.035265 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:01.098060 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.098028 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:01.153378 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.153342 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79655f7bfd-x67th" podUID="398f1991-e534-4249-a9d3-5c6f2fc99040" containerName="console" containerID="cri-o://637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405" gracePeriod=15 Jul 08 00:12:01.391553 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.391525 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:12:01.437451 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.437423 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-service-ca\") pod \"398f1991-e534-4249-a9d3-5c6f2fc99040\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " Jul 08 00:12:01.437451 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.437458 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-console-config\") pod \"398f1991-e534-4249-a9d3-5c6f2fc99040\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " Jul 08 00:12:01.437689 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.437512 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8tk2\" (UniqueName: \"kubernetes.io/projected/398f1991-e534-4249-a9d3-5c6f2fc99040-kube-api-access-g8tk2\") pod \"398f1991-e534-4249-a9d3-5c6f2fc99040\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " Jul 08 00:12:01.437689 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.437554 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-oauth-config\") pod \"398f1991-e534-4249-a9d3-5c6f2fc99040\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " Jul 08 00:12:01.437689 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.437594 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-oauth-serving-cert\") pod \"398f1991-e534-4249-a9d3-5c6f2fc99040\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " Jul 08 00:12:01.437689 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.437623 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-serving-cert\") pod \"398f1991-e534-4249-a9d3-5c6f2fc99040\" (UID: \"398f1991-e534-4249-a9d3-5c6f2fc99040\") " Jul 08 00:12:01.437931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.437902 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-service-ca" (OuterVolumeSpecName: "service-ca") pod "398f1991-e534-4249-a9d3-5c6f2fc99040" (UID: "398f1991-e534-4249-a9d3-5c6f2fc99040"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:12:01.437996 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.437934 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-console-config" (OuterVolumeSpecName: "console-config") pod "398f1991-e534-4249-a9d3-5c6f2fc99040" (UID: "398f1991-e534-4249-a9d3-5c6f2fc99040"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:12:01.438044 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.438013 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "398f1991-e534-4249-a9d3-5c6f2fc99040" (UID: "398f1991-e534-4249-a9d3-5c6f2fc99040"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:12:01.439871 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.439840 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "398f1991-e534-4249-a9d3-5c6f2fc99040" (UID: "398f1991-e534-4249-a9d3-5c6f2fc99040"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:12:01.439976 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.439871 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398f1991-e534-4249-a9d3-5c6f2fc99040-kube-api-access-g8tk2" (OuterVolumeSpecName: "kube-api-access-g8tk2") pod "398f1991-e534-4249-a9d3-5c6f2fc99040" (UID: "398f1991-e534-4249-a9d3-5c6f2fc99040"). InnerVolumeSpecName "kube-api-access-g8tk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:12:01.439976 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.439874 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "398f1991-e534-4249-a9d3-5c6f2fc99040" (UID: "398f1991-e534-4249-a9d3-5c6f2fc99040"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:12:01.538828 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.538786 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8tk2\" (UniqueName: \"kubernetes.io/projected/398f1991-e534-4249-a9d3-5c6f2fc99040-kube-api-access-g8tk2\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:01.538828 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.538822 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-oauth-config\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:01.538828 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.538831 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-oauth-serving-cert\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:01.538828 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.538839 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398f1991-e534-4249-a9d3-5c6f2fc99040-console-serving-cert\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:01.539191 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.538849 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-service-ca\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:01.539191 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.538858 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398f1991-e534-4249-a9d3-5c6f2fc99040-console-config\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:01.761877 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.761790 2573 generic.go:356] "Generic (PLEG): container finished" podID="398f1991-e534-4249-a9d3-5c6f2fc99040" containerID="637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405" exitCode=0 Jul 08 00:12:01.761877 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.761842 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79655f7bfd-x67th" Jul 08 00:12:01.761877 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.761851 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79655f7bfd-x67th" event={"ID":"398f1991-e534-4249-a9d3-5c6f2fc99040","Type":"ContainerDied","Data":"637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405"} Jul 08 00:12:01.762112 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.761903 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79655f7bfd-x67th" event={"ID":"398f1991-e534-4249-a9d3-5c6f2fc99040","Type":"ContainerDied","Data":"778386c4c6bbe2fd8823d49571a1a3c4d7debe5c2e844e0b34474853a8bb6a9b"} Jul 08 00:12:01.762112 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.761931 2573 scope.go:117] "RemoveContainer" containerID="637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405" Jul 08 00:12:01.770824 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.770805 2573 scope.go:117] "RemoveContainer" containerID="637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405" Jul 08 00:12:01.771108 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:12:01.771076 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405\": container with ID starting with 637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405 not found: ID does not exist" containerID="637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405" Jul 08 00:12:01.771156 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.771119 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405"} err="failed to get container status \"637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405\": rpc error: code = NotFound desc = could not find container \"637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405\": container with ID starting with 637e4e0b55a16d17b3b82dd4c17cdcf0ea958f769223531e927a03f9fc447405 not found: ID does not exist" Jul 08 00:12:01.782014 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.781986 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79655f7bfd-x67th"] Jul 08 00:12:01.785509 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.785486 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79655f7bfd-x67th"] Jul 08 00:12:01.817455 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:01.817431 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xz689_0a93cca2-2333-4667-bd1d-20422aec61f3/serve-healthcheck-canary/0.log" Jul 08 00:12:02.114560 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:02.114526 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398f1991-e534-4249-a9d3-5c6f2fc99040" path="/var/lib/kubelet/pods/398f1991-e534-4249-a9d3-5c6f2fc99040/volumes" Jul 08 00:12:06.254713 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:06.254677 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:06.351942 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:06.351902 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:36.799606 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:36.799562 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:36.856297 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:36.856263 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:41.049887 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.049852 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 00:12:41.050398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.050141 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="alertmanager" containerID="cri-o://d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c" gracePeriod=120 Jul 08 00:12:41.050398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.050222 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy-web" containerID="cri-o://bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625" gracePeriod=120 Jul 08 00:12:41.050398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.050239 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="config-reloader" containerID="cri-o://e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858" gracePeriod=120 Jul 08 00:12:41.050398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.050257 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy" containerID="cri-o://3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5" gracePeriod=120 Jul 08 00:12:41.050398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.050266 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="prom-label-proxy" containerID="cri-o://b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8" gracePeriod=120 Jul 08 00:12:41.050398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.050203 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy-metric" containerID="cri-o://671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60" gracePeriod=120 Jul 08 00:12:41.920527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920489 2573 generic.go:356] "Generic (PLEG): container finished" podID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerID="b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8" exitCode=0 Jul 08 00:12:41.920527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920514 2573 generic.go:356] "Generic (PLEG): container finished" podID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerID="671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60" exitCode=0 Jul 08 00:12:41.920527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920520 2573 generic.go:356] "Generic (PLEG): container finished" podID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerID="3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5" exitCode=0 Jul 08 00:12:41.920527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920528 2573 generic.go:356] "Generic (PLEG): container finished" podID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerID="e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858" exitCode=0 Jul 08 00:12:41.920527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920533 2573 generic.go:356] "Generic (PLEG): container finished" podID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerID="d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c" exitCode=0 Jul 08 00:12:41.920817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920558 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerDied","Data":"b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8"} Jul 08 00:12:41.920817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920621 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerDied","Data":"671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60"} Jul 08 00:12:41.920817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920646 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerDied","Data":"3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5"} Jul 08 00:12:41.920817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920672 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerDied","Data":"e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858"} Jul 08 00:12:41.920817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:41.920696 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerDied","Data":"d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c"} Jul 08 00:12:42.293469 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.293441 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:42.469272 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469182 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-trusted-ca-bundle\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469272 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469237 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-cluster-tls-config\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469277 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469300 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469331 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-tls-assets\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469366 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-config-volume\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469413 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-web-config\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469437 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-main-tls\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469466 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-metrics-client-ca\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469493 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-main-db\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469905 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469519 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-config-out\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469905 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469541 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjfbx\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-kube-api-access-tjfbx\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469905 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469576 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-web\") pod \"1e7fde5f-f929-4035-be64-15f9ead763c4\" (UID: \"1e7fde5f-f929-4035-be64-15f9ead763c4\") " Jul 08 00:12:42.469905 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469585 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:12:42.469905 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469799 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.470186 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.469979 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:12:42.471176 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.471147 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:12:42.472741 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.472714 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:12:42.473180 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.473139 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:12:42.473180 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.473157 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-config-out" (OuterVolumeSpecName: "config-out") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:12:42.473342 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.473222 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:12:42.473342 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.473242 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-config-volume" (OuterVolumeSpecName: "config-volume") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:12:42.473342 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.473319 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:12:42.473947 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.473929 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-kube-api-access-tjfbx" (OuterVolumeSpecName: "kube-api-access-tjfbx") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "kube-api-access-tjfbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:12:42.474716 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.474703 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:12:42.476970 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.476942 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:12:42.483294 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.483268 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-web-config" (OuterVolumeSpecName: "web-config") pod "1e7fde5f-f929-4035-be64-15f9ead763c4" (UID: "1e7fde5f-f929-4035-be64-15f9ead763c4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:12:42.570838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570785 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-config-volume\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.570838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570832 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-web-config\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.570838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570843 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-main-tls\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.570838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570853 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e7fde5f-f929-4035-be64-15f9ead763c4-metrics-client-ca\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.571127 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570863 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-alertmanager-main-db\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.571127 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570871 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e7fde5f-f929-4035-be64-15f9ead763c4-config-out\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.571127 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570879 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjfbx\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-kube-api-access-tjfbx\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.571127 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570890 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.571127 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570899 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-cluster-tls-config\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.571127 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570908 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.571127 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570917 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e7fde5f-f929-4035-be64-15f9ead763c4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.571127 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.570926 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e7fde5f-f929-4035-be64-15f9ead763c4-tls-assets\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:12:42.927450 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.927418 2573 generic.go:356] "Generic (PLEG): container finished" podID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerID="bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625" exitCode=0 Jul 08 00:12:42.927631 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.927456 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerDied","Data":"bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625"} Jul 08 00:12:42.927631 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.927527 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:42.927631 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.927554 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1e7fde5f-f929-4035-be64-15f9ead763c4","Type":"ContainerDied","Data":"4f07f054fb21a1e0e46732e5df1eea7d20edfcded8c5fff018aada0cd843a436"} Jul 08 00:12:42.927631 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.927587 2573 scope.go:117] "RemoveContainer" containerID="b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8" Jul 08 00:12:42.936362 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.936207 2573 scope.go:117] "RemoveContainer" containerID="671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60" Jul 08 00:12:42.943328 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.943309 2573 scope.go:117] "RemoveContainer" containerID="3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5" Jul 08 00:12:42.949727 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.949708 2573 scope.go:117] "RemoveContainer" containerID="bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625" Jul 08 00:12:42.952647 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.952625 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 00:12:42.955975 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.955954 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 00:12:42.957201 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.957190 2573 scope.go:117] "RemoveContainer" containerID="e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858" Jul 08 00:12:42.963947 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.963928 2573 scope.go:117] "RemoveContainer" containerID="d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c" Jul 08 00:12:42.971057 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.971030 2573 scope.go:117] "RemoveContainer" containerID="514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2" Jul 08 00:12:42.978226 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.978149 2573 scope.go:117] "RemoveContainer" containerID="b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8" Jul 08 00:12:42.978620 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:12:42.978593 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8\": container with ID starting with b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8 not found: ID does not exist" containerID="b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8" Jul 08 00:12:42.978733 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.978630 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8"} err="failed to get container status \"b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8\": rpc error: code = NotFound desc = could not find container \"b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8\": container with ID starting with b51a3a19f9511a1d4442b6ccc79ae9578a9e0060558ec54a346fa50856dee3d8 not found: ID does not exist" Jul 08 00:12:42.978733 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.978675 2573 scope.go:117] "RemoveContainer" containerID="671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60" Jul 08 00:12:42.979150 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:12:42.978977 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60\": container with ID starting with 671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60 not found: ID does not exist" containerID="671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60" Jul 08 00:12:42.979150 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.979009 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60"} err="failed to get container status \"671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60\": rpc error: code = NotFound desc = could not find container \"671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60\": container with ID starting with 671a9f165ccbadf234f87aafb07bd648b3390bf4414e763848c45a9954566e60 not found: ID does not exist" Jul 08 00:12:42.979150 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.979030 2573 scope.go:117] "RemoveContainer" containerID="3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5" Jul 08 00:12:42.979588 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:12:42.979567 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5\": container with ID starting with 3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5 not found: ID does not exist" containerID="3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5" Jul 08 00:12:42.979671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.979590 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5"} err="failed to get container status \"3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5\": rpc error: code = NotFound desc = could not find container \"3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5\": container with ID starting with 3ec092ed134bbad4750d203e9f387aab79be4e1bcb0c7a4c2b5a65647e8d16a5 not found: ID does not exist" Jul 08 00:12:42.979671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.979607 2573 scope.go:117] "RemoveContainer" containerID="bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625" Jul 08 00:12:42.979846 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:12:42.979830 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625\": container with ID starting with bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625 not found: ID does not exist" containerID="bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625" Jul 08 00:12:42.979899 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.979851 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625"} err="failed to get container status \"bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625\": rpc error: code = NotFound desc = could not find container \"bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625\": container with ID starting with bd0aeb196636af04796c4eb9479cbc3f25b88816ac1f46557697ca003b7a9625 not found: ID does not exist" Jul 08 00:12:42.979899 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.979865 2573 scope.go:117] "RemoveContainer" containerID="e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858" Jul 08 00:12:42.980153 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:12:42.980135 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858\": container with ID starting with e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858 not found: ID does not exist" containerID="e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858" Jul 08 00:12:42.980217 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980158 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858"} err="failed to get container status \"e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858\": rpc error: code = NotFound desc = could not find container \"e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858\": container with ID starting with e47de4f9e9d05ff71f56dad30ad47b32da3cf38be70d9076fd8f829f91cb5858 not found: ID does not exist" Jul 08 00:12:42.980217 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980174 2573 scope.go:117] "RemoveContainer" containerID="d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c" Jul 08 00:12:42.980415 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:12:42.980393 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c\": container with ID starting with d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c not found: ID does not exist" containerID="d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c" Jul 08 00:12:42.980466 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980419 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c"} err="failed to get container status \"d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c\": rpc error: code = NotFound desc = could not find container \"d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c\": container with ID starting with d8e59d24a9647765ea876317822da08d07f1a4b4988e11bb6f490cc0143e453c not found: ID does not exist" Jul 08 00:12:42.980466 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980434 2573 scope.go:117] "RemoveContainer" containerID="514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2" Jul 08 00:12:42.980546 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980403 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 00:12:42.980628 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:12:42.980613 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2\": container with ID starting with 514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2 not found: ID does not exist" containerID="514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2" Jul 08 00:12:42.980666 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980631 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2"} err="failed to get container status \"514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2\": rpc error: code = NotFound desc = could not find container \"514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2\": container with ID starting with 514cf3056dac41f6639ec1c8cce91995becf1a2335ed24fafa27784b2513faf2 not found: ID does not exist" Jul 08 00:12:42.980751 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980740 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy-metric" Jul 08 00:12:42.980787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980756 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy-metric" Jul 08 00:12:42.980787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980765 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" containerName="registry" Jul 08 00:12:42.980787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980770 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" containerName="registry" Jul 08 00:12:42.980787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980777 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="alertmanager" Jul 08 00:12:42.980787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980782 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="alertmanager" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980789 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="prom-label-proxy" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980794 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="prom-label-proxy" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980804 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="config-reloader" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980811 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="config-reloader" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980817 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy-web" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980822 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy-web" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980832 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398f1991-e534-4249-a9d3-5c6f2fc99040" containerName="console" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980837 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="398f1991-e534-4249-a9d3-5c6f2fc99040" containerName="console" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980843 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980848 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980855 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="init-config-reloader" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980860 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="init-config-reloader" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980901 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980907 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c5a17a0-6cef-46f5-9a41-fa73b1ed7a04" containerName="registry" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980912 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="prom-label-proxy" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980919 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="alertmanager" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980925 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy-web" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980930 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="398f1991-e534-4249-a9d3-5c6f2fc99040" containerName="console" Jul 08 00:12:42.980931 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980937 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="config-reloader" Jul 08 00:12:42.981460 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.980943 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" containerName="kube-rbac-proxy-metric" Jul 08 00:12:42.986345 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.986325 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:42.988998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.988972 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 00:12:42.989123 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.989038 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 00:12:42.989123 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.989039 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gfw24\"" Jul 08 00:12:42.989413 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.989392 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 00:12:42.989516 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.989422 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 00:12:42.989516 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.989399 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 00:12:42.989516 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.989455 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 00:12:42.989516 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.989396 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 00:12:42.989687 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.989422 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 00:12:42.993472 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.993453 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 00:12:42.999557 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:42.999535 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 00:12:43.074273 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707b377d-57d9-4de9-93d0-d5550bed7480-tls-assets\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074282 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf78t\" (UniqueName: \"kubernetes.io/projected/707b377d-57d9-4de9-93d0-d5550bed7480-kube-api-access-wf78t\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074350 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-config-volume\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074369 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074392 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-web-config\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074426 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/707b377d-57d9-4de9-93d0-d5550bed7480-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074447 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074685 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707b377d-57d9-4de9-93d0-d5550bed7480-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074685 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074497 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707b377d-57d9-4de9-93d0-d5550bed7480-config-out\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074685 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074512 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074685 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707b377d-57d9-4de9-93d0-d5550bed7480-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.074685 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.074594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.174965 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.174924 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707b377d-57d9-4de9-93d0-d5550bed7480-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.174965 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.174966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707b377d-57d9-4de9-93d0-d5550bed7480-config-out\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175236 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.174994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175236 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707b377d-57d9-4de9-93d0-d5550bed7480-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175236 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175236 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175078 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707b377d-57d9-4de9-93d0-d5550bed7480-tls-assets\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175407 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175407 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175277 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf78t\" (UniqueName: \"kubernetes.io/projected/707b377d-57d9-4de9-93d0-d5550bed7480-kube-api-access-wf78t\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175407 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175315 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-config-volume\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175407 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175341 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175407 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175368 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-web-config\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175407 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/707b377d-57d9-4de9-93d0-d5550bed7480-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175715 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.175913 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707b377d-57d9-4de9-93d0-d5550bed7480-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.176012 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.175926 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707b377d-57d9-4de9-93d0-d5550bed7480-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.176886 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.176528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/707b377d-57d9-4de9-93d0-d5550bed7480-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.177932 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.177862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707b377d-57d9-4de9-93d0-d5550bed7480-config-out\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.178224 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.178199 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.178587 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.178553 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.178666 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.178567 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-web-config\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.178666 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.178654 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-config-volume\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.178741 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.178698 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.178891 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.178867 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707b377d-57d9-4de9-93d0-d5550bed7480-tls-assets\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.179665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.179648 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.180054 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.180040 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/707b377d-57d9-4de9-93d0-d5550bed7480-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.183354 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.183337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf78t\" (UniqueName: \"kubernetes.io/projected/707b377d-57d9-4de9-93d0-d5550bed7480-kube-api-access-wf78t\") pod \"alertmanager-main-0\" (UID: \"707b377d-57d9-4de9-93d0-d5550bed7480\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.295538 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.295500 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 00:12:43.435372 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.435239 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 00:12:43.437915 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:12:43.437883 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707b377d_57d9_4de9_93d0_d5550bed7480.slice/crio-7812fc5676ead637ffc1f24f3439b6cdd35062c9f6f6601f9f57197e3f705186 WatchSource:0}: Error finding container 7812fc5676ead637ffc1f24f3439b6cdd35062c9f6f6601f9f57197e3f705186: Status 404 returned error can't find the container with id 7812fc5676ead637ffc1f24f3439b6cdd35062c9f6f6601f9f57197e3f705186 Jul 08 00:12:43.934066 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.934024 2573 generic.go:356] "Generic (PLEG): container finished" podID="707b377d-57d9-4de9-93d0-d5550bed7480" containerID="6dc0270784ffd3375388242fb7b861f34a6a5d7052ff81884b5503798f1a14ed" exitCode=0 Jul 08 00:12:43.934233 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.934065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707b377d-57d9-4de9-93d0-d5550bed7480","Type":"ContainerDied","Data":"6dc0270784ffd3375388242fb7b861f34a6a5d7052ff81884b5503798f1a14ed"} Jul 08 00:12:43.934233 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:43.934168 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707b377d-57d9-4de9-93d0-d5550bed7480","Type":"ContainerStarted","Data":"7812fc5676ead637ffc1f24f3439b6cdd35062c9f6f6601f9f57197e3f705186"} Jul 08 00:12:44.116091 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:44.116066 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e7fde5f-f929-4035-be64-15f9ead763c4" path="/var/lib/kubelet/pods/1e7fde5f-f929-4035-be64-15f9ead763c4/volumes" Jul 08 00:12:44.943193 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:44.943152 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707b377d-57d9-4de9-93d0-d5550bed7480","Type":"ContainerStarted","Data":"f02b22f0c2b403778a5a9ae08b96c5ee77d34d1a10e9a47c76023c096832dd0d"} Jul 08 00:12:44.943572 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:44.943237 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707b377d-57d9-4de9-93d0-d5550bed7480","Type":"ContainerStarted","Data":"99947473fef65da6d0d11141053f3dd390d6975b677dec2d1b51d8b9d12ed50a"} Jul 08 00:12:44.943572 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:44.943284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707b377d-57d9-4de9-93d0-d5550bed7480","Type":"ContainerStarted","Data":"a207e80e600370d47bf3bc08036bead3cd124cdc7e0055d7cc063e78fec39941"} Jul 08 00:12:44.943572 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:44.943320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707b377d-57d9-4de9-93d0-d5550bed7480","Type":"ContainerStarted","Data":"02894747bd27217dc31570eecaab52a829c760a74851d3e6324ef44b029a9b1d"} Jul 08 00:12:44.943572 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:44.943357 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707b377d-57d9-4de9-93d0-d5550bed7480","Type":"ContainerStarted","Data":"3c1bc9ce1bb38f0445b27096f72427418da9baa574189bcdd7b553b899a64957"} Jul 08 00:12:44.943572 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:44.943394 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"707b377d-57d9-4de9-93d0-d5550bed7480","Type":"ContainerStarted","Data":"b92866a3ad4a316f5ad5dcae5625b652d938fbbe327bec0785979e102b8eb774"} Jul 08 00:12:44.973515 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:44.973464 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.958140285 podStartE2EDuration="2.973447812s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.307527ms" isStatefulPod=false podCreationTimestamp="2026-07-08 00:12:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:12:44.971056894 +0000 UTC m=+167.449902222" watchObservedRunningTime="2026-07-08 00:12:44.973447812 +0000 UTC m=+167.452293065" Jul 08 00:12:48.754479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:48.754443 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:48.806563 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:48.806530 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:51.695271 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:51.695199 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:59.189903 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:59.189866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:12:59.290652 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:12:59.290619 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:01.139414 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:01.139379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:08.807752 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.807714 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789b4fbdbc-r7mw8"] Jul 08 00:13:08.810904 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.810880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.813887 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.813867 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 00:13:08.815168 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.815151 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8vrqt\"" Jul 08 00:13:08.815317 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.815297 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 00:13:08.815416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.815395 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 00:13:08.815488 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.815466 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 00:13:08.815549 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.815533 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 00:13:08.819745 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.819725 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 00:13:08.821020 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.821001 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789b4fbdbc-r7mw8"] Jul 08 00:13:08.885171 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.885133 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-service-ca\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.885352 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.885183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-console-config\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.885352 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.885216 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-trusted-ca-bundle\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.885352 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.885250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-oauth-serving-cert\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.885352 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.885274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-oauth-config\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.885352 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.885297 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-serving-cert\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.885352 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.885346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9mw9\" (UniqueName: \"kubernetes.io/projected/71187a58-19d9-42ea-977a-c1bb66358a02-kube-api-access-s9mw9\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.903420 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.903388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:08.954395 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.954367 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:08.986559 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.986526 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9mw9\" (UniqueName: \"kubernetes.io/projected/71187a58-19d9-42ea-977a-c1bb66358a02-kube-api-access-s9mw9\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.986741 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.986572 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-service-ca\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.986741 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.986597 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-console-config\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.986741 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.986614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-trusted-ca-bundle\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.986741 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.986632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-oauth-serving-cert\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.986741 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.986651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-oauth-config\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.986741 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.986667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-serving-cert\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.987357 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.987334 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-service-ca\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.987495 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.987438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-console-config\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.987601 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.987575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-oauth-serving-cert\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.987705 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.987637 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-trusted-ca-bundle\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.989124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.989088 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-oauth-config\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.989234 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.989218 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-serving-cert\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:08.994386 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:08.994361 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9mw9\" (UniqueName: \"kubernetes.io/projected/71187a58-19d9-42ea-977a-c1bb66358a02-kube-api-access-s9mw9\") pod \"console-789b4fbdbc-r7mw8\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:09.018053 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:09.018022 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:09.072141 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:09.072041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:09.120765 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:09.120730 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:09.251958 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:09.251937 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789b4fbdbc-r7mw8"] Jul 08 00:13:09.254225 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:13:09.254198 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71187a58_19d9_42ea_977a_c1bb66358a02.slice/crio-70e43fe7c8f56d2821d1ccdc34d82dd1351d79a61f13e77bc3b684c52e79a0a0 WatchSource:0}: Error finding container 70e43fe7c8f56d2821d1ccdc34d82dd1351d79a61f13e77bc3b684c52e79a0a0: Status 404 returned error can't find the container with id 70e43fe7c8f56d2821d1ccdc34d82dd1351d79a61f13e77bc3b684c52e79a0a0 Jul 08 00:13:09.823885 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:09.823851 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:09.873373 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:09.873342 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:10.038175 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:10.038140 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789b4fbdbc-r7mw8" event={"ID":"71187a58-19d9-42ea-977a-c1bb66358a02","Type":"ContainerStarted","Data":"ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295"} Jul 08 00:13:10.038355 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:10.038219 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789b4fbdbc-r7mw8" event={"ID":"71187a58-19d9-42ea-977a-c1bb66358a02","Type":"ContainerStarted","Data":"70e43fe7c8f56d2821d1ccdc34d82dd1351d79a61f13e77bc3b684c52e79a0a0"} Jul 08 00:13:10.054862 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:10.054806 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789b4fbdbc-r7mw8" podStartSLOduration=2.054788608 podStartE2EDuration="2.054788608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:13:10.052851152 +0000 UTC m=+192.531696403" watchObservedRunningTime="2026-07-08 00:13:10.054788608 +0000 UTC m=+192.533633861" Jul 08 00:13:16.889971 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:16.889937 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:19.120888 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:19.120843 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:19.121392 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:19.120911 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:19.125919 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:19.125895 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:20.078551 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:20.078521 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:13:20.208635 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:20.208602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:20.307846 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:20.307815 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:27.908580 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:27.908544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:28.008976 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:28.008947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:31.988237 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:31.988187 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:32.089110 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:32.089069 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:54.066845 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.066798 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:54.161980 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.161922 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:13:54.634073 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.634031 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr"] Jul 08 00:13:54.636365 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.636348 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.639454 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.639427 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 00:13:54.639737 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.639721 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lh9fh\"" Jul 08 00:13:54.640718 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.640699 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 00:13:54.645425 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.645400 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr"] Jul 08 00:13:54.671399 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.671360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.671399 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.671397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc6rb\" (UniqueName: \"kubernetes.io/projected/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-kube-api-access-lc6rb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.671609 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.671443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.772355 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.772312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.772515 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.772397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.772515 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.772426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc6rb\" (UniqueName: \"kubernetes.io/projected/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-kube-api-access-lc6rb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.772787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.772766 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.772826 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.772775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.780720 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.780693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc6rb\" (UniqueName: \"kubernetes.io/projected/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-kube-api-access-lc6rb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:54.947568 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:54.947478 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:13:55.071664 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:55.071637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr"] Jul 08 00:13:55.074428 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:13:55.074401 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod227d5893_fbe1_4316_b1b2_7ef94fa72cb9.slice/crio-c375ec6cc3de019817476f3cbd1361fbc0c326aa4c5bab68f57614a3ad64505b WatchSource:0}: Error finding container c375ec6cc3de019817476f3cbd1361fbc0c326aa4c5bab68f57614a3ad64505b: Status 404 returned error can't find the container with id c375ec6cc3de019817476f3cbd1361fbc0c326aa4c5bab68f57614a3ad64505b Jul 08 00:13:55.206008 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:13:55.205912 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" event={"ID":"227d5893-fbe1-4316-b1b2-7ef94fa72cb9","Type":"ContainerStarted","Data":"c375ec6cc3de019817476f3cbd1361fbc0c326aa4c5bab68f57614a3ad64505b"} Jul 08 00:14:04.243443 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:04.243405 2573 generic.go:356] "Generic (PLEG): container finished" podID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerID="3000ba0382ddae17bafc188b6224c7e193c5c874d18f57d1de689c9e75c85473" exitCode=0 Jul 08 00:14:04.243843 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:04.243496 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" event={"ID":"227d5893-fbe1-4316-b1b2-7ef94fa72cb9","Type":"ContainerDied","Data":"3000ba0382ddae17bafc188b6224c7e193c5c874d18f57d1de689c9e75c85473"} Jul 08 00:14:06.253440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:06.253402 2573 generic.go:356] "Generic (PLEG): container finished" podID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerID="3be4329849c520e17c280fd8976f88840e593a0e688fad5c58bee9522684a61a" exitCode=0 Jul 08 00:14:06.253794 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:06.253494 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" event={"ID":"227d5893-fbe1-4316-b1b2-7ef94fa72cb9","Type":"ContainerDied","Data":"3be4329849c520e17c280fd8976f88840e593a0e688fad5c58bee9522684a61a"} Jul 08 00:14:15.292721 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:15.292684 2573 generic.go:356] "Generic (PLEG): container finished" podID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerID="38a55286b56276067e43c6f12e0ab96301ce3c02f7a89e732dd8379e6854342c" exitCode=0 Jul 08 00:14:15.293146 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:15.292746 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" event={"ID":"227d5893-fbe1-4316-b1b2-7ef94fa72cb9","Type":"ContainerDied","Data":"38a55286b56276067e43c6f12e0ab96301ce3c02f7a89e732dd8379e6854342c"} Jul 08 00:14:16.426511 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.426479 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:14:16.565811 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.565720 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-bundle\") pod \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " Jul 08 00:14:16.565811 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.565764 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-util\") pod \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " Jul 08 00:14:16.565811 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.565810 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc6rb\" (UniqueName: \"kubernetes.io/projected/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-kube-api-access-lc6rb\") pod \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\" (UID: \"227d5893-fbe1-4316-b1b2-7ef94fa72cb9\") " Jul 08 00:14:16.566592 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.566563 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-bundle" (OuterVolumeSpecName: "bundle") pod "227d5893-fbe1-4316-b1b2-7ef94fa72cb9" (UID: "227d5893-fbe1-4316-b1b2-7ef94fa72cb9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:14:16.567983 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.567960 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-kube-api-access-lc6rb" (OuterVolumeSpecName: "kube-api-access-lc6rb") pod "227d5893-fbe1-4316-b1b2-7ef94fa72cb9" (UID: "227d5893-fbe1-4316-b1b2-7ef94fa72cb9"). InnerVolumeSpecName "kube-api-access-lc6rb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:14:16.570206 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.570178 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-util" (OuterVolumeSpecName: "util") pod "227d5893-fbe1-4316-b1b2-7ef94fa72cb9" (UID: "227d5893-fbe1-4316-b1b2-7ef94fa72cb9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:14:16.666453 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.666418 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-util\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:14:16.666453 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.666447 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc6rb\" (UniqueName: \"kubernetes.io/projected/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-kube-api-access-lc6rb\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:14:16.666453 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:16.666457 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/227d5893-fbe1-4316-b1b2-7ef94fa72cb9-bundle\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:14:17.302941 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:17.302905 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" event={"ID":"227d5893-fbe1-4316-b1b2-7ef94fa72cb9","Type":"ContainerDied","Data":"c375ec6cc3de019817476f3cbd1361fbc0c326aa4c5bab68f57614a3ad64505b"} Jul 08 00:14:17.302941 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:17.302939 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mw4qr" Jul 08 00:14:17.303184 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:17.302955 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c375ec6cc3de019817476f3cbd1361fbc0c326aa4c5bab68f57614a3ad64505b" Jul 08 00:14:20.662270 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:20.662178 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:21.468706 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:21.468675 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:22.530422 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.530393 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg"] Jul 08 00:14:22.530923 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.530808 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerName="util" Jul 08 00:14:22.530923 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.530826 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerName="util" Jul 08 00:14:22.530923 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.530853 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerName="pull" Jul 08 00:14:22.530923 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.530862 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerName="pull" Jul 08 00:14:22.530923 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.530871 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerName="extract" Jul 08 00:14:22.530923 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.530879 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerName="extract" Jul 08 00:14:22.531245 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.530955 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="227d5893-fbe1-4316-b1b2-7ef94fa72cb9" containerName="extract" Jul 08 00:14:22.533042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.533023 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" Jul 08 00:14:22.535755 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.535723 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 00:14:22.535902 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.535765 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 00:14:22.536000 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.535984 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jkr66\"" Jul 08 00:14:22.543282 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.543258 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg"] Jul 08 00:14:22.616856 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.616817 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m49sz\" (UniqueName: \"kubernetes.io/projected/190268e2-1222-41ba-8433-de30d7315ed9-kube-api-access-m49sz\") pod \"cert-manager-operator-controller-manager-55c444bf86-7rbqg\" (UID: \"190268e2-1222-41ba-8433-de30d7315ed9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" Jul 08 00:14:22.617014 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.616871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/190268e2-1222-41ba-8433-de30d7315ed9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7rbqg\" (UID: \"190268e2-1222-41ba-8433-de30d7315ed9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" Jul 08 00:14:22.718074 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.718031 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m49sz\" (UniqueName: \"kubernetes.io/projected/190268e2-1222-41ba-8433-de30d7315ed9-kube-api-access-m49sz\") pod \"cert-manager-operator-controller-manager-55c444bf86-7rbqg\" (UID: \"190268e2-1222-41ba-8433-de30d7315ed9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" Jul 08 00:14:22.718292 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.718152 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/190268e2-1222-41ba-8433-de30d7315ed9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7rbqg\" (UID: \"190268e2-1222-41ba-8433-de30d7315ed9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" Jul 08 00:14:22.718436 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.718419 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/190268e2-1222-41ba-8433-de30d7315ed9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-7rbqg\" (UID: \"190268e2-1222-41ba-8433-de30d7315ed9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" Jul 08 00:14:22.729360 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.729328 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m49sz\" (UniqueName: \"kubernetes.io/projected/190268e2-1222-41ba-8433-de30d7315ed9-kube-api-access-m49sz\") pod \"cert-manager-operator-controller-manager-55c444bf86-7rbqg\" (UID: \"190268e2-1222-41ba-8433-de30d7315ed9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" Jul 08 00:14:22.841892 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.841860 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" Jul 08 00:14:22.981817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:22.981784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg"] Jul 08 00:14:22.985953 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:14:22.985927 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190268e2_1222_41ba_8433_de30d7315ed9.slice/crio-625a0a74c01180aab3023a56d304280be7143f5fb9b1831360bf6f83a6079baa WatchSource:0}: Error finding container 625a0a74c01180aab3023a56d304280be7143f5fb9b1831360bf6f83a6079baa: Status 404 returned error can't find the container with id 625a0a74c01180aab3023a56d304280be7143f5fb9b1831360bf6f83a6079baa Jul 08 00:14:23.327347 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:23.327314 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" event={"ID":"190268e2-1222-41ba-8433-de30d7315ed9","Type":"ContainerStarted","Data":"625a0a74c01180aab3023a56d304280be7143f5fb9b1831360bf6f83a6079baa"} Jul 08 00:14:24.248419 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:24.248376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:24.348483 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:24.348442 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:25.344567 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:25.344527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" event={"ID":"190268e2-1222-41ba-8433-de30d7315ed9","Type":"ContainerStarted","Data":"cc3de04fabdd239f8a4eae5281055a4a5d211cd155e7db33d661ef564692dfe6"} Jul 08 00:14:25.366705 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:25.366647 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-7rbqg" podStartSLOduration=1.780250933 podStartE2EDuration="3.366631671s" totalImagesPullingTime="1.586380738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:14:25.363905847 +0000 UTC m=+267.842751104" watchObservedRunningTime="2026-07-08 00:14:25.366631671 +0000 UTC m=+267.845476925" Jul 08 00:14:25.819317 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:25.819278 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:25.924442 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:25.924388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:26.411828 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.411793 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:26.511332 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.511279 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:26.572436 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.572398 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn"] Jul 08 00:14:26.575128 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.575092 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.577771 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.577738 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 00:14:26.577771 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.577738 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lh9fh\"" Jul 08 00:14:26.579058 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.579037 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 00:14:26.583663 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.583640 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn"] Jul 08 00:14:26.593135 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.593109 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wwz48"] Jul 08 00:14:26.595173 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.595148 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:26.598032 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.597999 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tvxjv\"" Jul 08 00:14:26.598032 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.598031 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 00:14:26.598287 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.598272 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 00:14:26.606113 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.606071 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wwz48"] Jul 08 00:14:26.653350 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.653317 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.653531 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.653357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skvm6\" (UniqueName: \"kubernetes.io/projected/9123cb9f-ede1-48a4-800b-408f4cc7fd85-kube-api-access-skvm6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.653531 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.653437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.754734 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.754634 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8864368f-40bb-48bd-a8d8-e4d583adc8a3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wwz48\" (UID: \"8864368f-40bb-48bd-a8d8-e4d583adc8a3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:26.754734 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.754706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.754947 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.754740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skvm6\" (UniqueName: \"kubernetes.io/projected/9123cb9f-ede1-48a4-800b-408f4cc7fd85-kube-api-access-skvm6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.754947 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.754784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gfqt\" (UniqueName: \"kubernetes.io/projected/8864368f-40bb-48bd-a8d8-e4d583adc8a3-kube-api-access-5gfqt\") pod \"cert-manager-webhook-6486ffd997-wwz48\" (UID: \"8864368f-40bb-48bd-a8d8-e4d583adc8a3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:26.754947 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.754835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.755159 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.755138 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.755207 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.755143 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.762569 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.762530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skvm6\" (UniqueName: \"kubernetes.io/projected/9123cb9f-ede1-48a4-800b-408f4cc7fd85-kube-api-access-skvm6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.855981 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.855937 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8864368f-40bb-48bd-a8d8-e4d583adc8a3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wwz48\" (UID: \"8864368f-40bb-48bd-a8d8-e4d583adc8a3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:26.856201 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.856133 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfqt\" (UniqueName: \"kubernetes.io/projected/8864368f-40bb-48bd-a8d8-e4d583adc8a3-kube-api-access-5gfqt\") pod \"cert-manager-webhook-6486ffd997-wwz48\" (UID: \"8864368f-40bb-48bd-a8d8-e4d583adc8a3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:26.867153 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.867113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8864368f-40bb-48bd-a8d8-e4d583adc8a3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wwz48\" (UID: \"8864368f-40bb-48bd-a8d8-e4d583adc8a3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:26.867433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.867415 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gfqt\" (UniqueName: \"kubernetes.io/projected/8864368f-40bb-48bd-a8d8-e4d583adc8a3-kube-api-access-5gfqt\") pod \"cert-manager-webhook-6486ffd997-wwz48\" (UID: \"8864368f-40bb-48bd-a8d8-e4d583adc8a3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:26.885229 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.885193 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:26.919483 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:26.919442 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:27.025368 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:27.025339 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn"] Jul 08 00:14:27.028582 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:14:27.028552 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9123cb9f_ede1_48a4_800b_408f4cc7fd85.slice/crio-e426b454ebc7fa99382c0d04d30e32f241a2c4ac23fbb2d71add527c753c513a WatchSource:0}: Error finding container e426b454ebc7fa99382c0d04d30e32f241a2c4ac23fbb2d71add527c753c513a: Status 404 returned error can't find the container with id e426b454ebc7fa99382c0d04d30e32f241a2c4ac23fbb2d71add527c753c513a Jul 08 00:14:27.059066 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:27.059035 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wwz48"] Jul 08 00:14:27.066279 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:14:27.066241 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8864368f_40bb_48bd_a8d8_e4d583adc8a3.slice/crio-d6fcf2cc0985c4b1a73d311b52f27e02e0a727b02360372e72e1b79f40f986b5 WatchSource:0}: Error finding container d6fcf2cc0985c4b1a73d311b52f27e02e0a727b02360372e72e1b79f40f986b5: Status 404 returned error can't find the container with id d6fcf2cc0985c4b1a73d311b52f27e02e0a727b02360372e72e1b79f40f986b5 Jul 08 00:14:27.354583 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:27.354545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" event={"ID":"8864368f-40bb-48bd-a8d8-e4d583adc8a3","Type":"ContainerStarted","Data":"d6fcf2cc0985c4b1a73d311b52f27e02e0a727b02360372e72e1b79f40f986b5"} Jul 08 00:14:27.355897 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:27.355866 2573 generic.go:356] "Generic (PLEG): container finished" podID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerID="823263b53c229a8cf00d44e0d926f952cd90f2472a4f7d11c2ebb62364842b0f" exitCode=0 Jul 08 00:14:27.356043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:27.355914 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" event={"ID":"9123cb9f-ede1-48a4-800b-408f4cc7fd85","Type":"ContainerDied","Data":"823263b53c229a8cf00d44e0d926f952cd90f2472a4f7d11c2ebb62364842b0f"} Jul 08 00:14:27.356043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:27.355973 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" event={"ID":"9123cb9f-ede1-48a4-800b-408f4cc7fd85","Type":"ContainerStarted","Data":"e426b454ebc7fa99382c0d04d30e32f241a2c4ac23fbb2d71add527c753c513a"} Jul 08 00:14:28.420746 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:28.420673 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:28.619913 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:28.619879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:28.820117 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:28.820066 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:31.047446 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:31.047408 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:31.147226 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:31.147193 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:31.376369 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:31.376278 2573 generic.go:356] "Generic (PLEG): container finished" podID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerID="d41aeea2cd73a2dd9b8e00ad68937088359e4ece048b8a437ada7ce5fd263be4" exitCode=0 Jul 08 00:14:31.376527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:31.376365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" event={"ID":"9123cb9f-ede1-48a4-800b-408f4cc7fd85","Type":"ContainerDied","Data":"d41aeea2cd73a2dd9b8e00ad68937088359e4ece048b8a437ada7ce5fd263be4"} Jul 08 00:14:31.377919 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:31.377899 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" event={"ID":"8864368f-40bb-48bd-a8d8-e4d583adc8a3","Type":"ContainerStarted","Data":"a7eab9eaae19be74c21792d3e72549de8de06e5e7a8b43d4d9a55530642de26b"} Jul 08 00:14:31.378052 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:31.378041 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:31.421548 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:31.421493 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" podStartSLOduration=1.986534222 podStartE2EDuration="5.421469062s" totalImagesPullingTime="3.43493484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:14:31.421342079 +0000 UTC m=+273.900187334" watchObservedRunningTime="2026-07-08 00:14:31.421469062 +0000 UTC m=+273.900314323" Jul 08 00:14:32.383836 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:32.383807 2573 generic.go:356] "Generic (PLEG): container finished" podID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerID="a68905cabf8bbd7f4deb14fcf60b656cebb0525d81d32b9786c8c45dbec0c484" exitCode=0 Jul 08 00:14:32.384360 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:32.383898 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" event={"ID":"9123cb9f-ede1-48a4-800b-408f4cc7fd85","Type":"ContainerDied","Data":"a68905cabf8bbd7f4deb14fcf60b656cebb0525d81d32b9786c8c45dbec0c484"} Jul 08 00:14:33.515481 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.515446 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:33.577398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.577367 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:33.617360 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.617322 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skvm6\" (UniqueName: \"kubernetes.io/projected/9123cb9f-ede1-48a4-800b-408f4cc7fd85-kube-api-access-skvm6\") pod \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " Jul 08 00:14:33.617563 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.617377 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-util\") pod \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " Jul 08 00:14:33.617563 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.617437 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-bundle\") pod \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\" (UID: \"9123cb9f-ede1-48a4-800b-408f4cc7fd85\") " Jul 08 00:14:33.617826 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.617788 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-bundle" (OuterVolumeSpecName: "bundle") pod "9123cb9f-ede1-48a4-800b-408f4cc7fd85" (UID: "9123cb9f-ede1-48a4-800b-408f4cc7fd85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:14:33.619436 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.619409 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9123cb9f-ede1-48a4-800b-408f4cc7fd85-kube-api-access-skvm6" (OuterVolumeSpecName: "kube-api-access-skvm6") pod "9123cb9f-ede1-48a4-800b-408f4cc7fd85" (UID: "9123cb9f-ede1-48a4-800b-408f4cc7fd85"). InnerVolumeSpecName "kube-api-access-skvm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:14:33.623894 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.623865 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-util" (OuterVolumeSpecName: "util") pod "9123cb9f-ede1-48a4-800b-408f4cc7fd85" (UID: "9123cb9f-ede1-48a4-800b-408f4cc7fd85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:14:33.650800 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.650718 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:33.718973 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.718936 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skvm6\" (UniqueName: \"kubernetes.io/projected/9123cb9f-ede1-48a4-800b-408f4cc7fd85-kube-api-access-skvm6\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:14:33.718973 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.718969 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-util\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:14:33.718973 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:33.718980 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9123cb9f-ede1-48a4-800b-408f4cc7fd85-bundle\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:14:34.393852 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:34.393774 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" event={"ID":"9123cb9f-ede1-48a4-800b-408f4cc7fd85","Type":"ContainerDied","Data":"e426b454ebc7fa99382c0d04d30e32f241a2c4ac23fbb2d71add527c753c513a"} Jul 08 00:14:34.393852 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:34.393818 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f594tn" Jul 08 00:14:34.394016 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:34.393820 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e426b454ebc7fa99382c0d04d30e32f241a2c4ac23fbb2d71add527c753c513a" Jul 08 00:14:36.805448 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:36.805413 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:37.386465 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:37.386432 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wwz48" Jul 08 00:14:39.380787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.380750 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-z6r57"] Jul 08 00:14:39.381189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.381039 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerName="util" Jul 08 00:14:39.381189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.381051 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerName="util" Jul 08 00:14:39.381189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.381069 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerName="extract" Jul 08 00:14:39.381189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.381075 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerName="extract" Jul 08 00:14:39.381189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.381089 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerName="pull" Jul 08 00:14:39.381189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.381107 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerName="pull" Jul 08 00:14:39.381189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.381181 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9123cb9f-ede1-48a4-800b-408f4cc7fd85" containerName="extract" Jul 08 00:14:39.384290 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.384271 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-z6r57" Jul 08 00:14:39.386844 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.386821 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qzjvk\"" Jul 08 00:14:39.393928 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.393905 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-z6r57"] Jul 08 00:14:39.568520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.568488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97707089-c7e5-4235-a885-ff3991f2ef4f-bound-sa-token\") pod \"cert-manager-55b4d954d5-z6r57\" (UID: \"97707089-c7e5-4235-a885-ff3991f2ef4f\") " pod="cert-manager/cert-manager-55b4d954d5-z6r57" Jul 08 00:14:39.568520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.568532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c22gl\" (UniqueName: \"kubernetes.io/projected/97707089-c7e5-4235-a885-ff3991f2ef4f-kube-api-access-c22gl\") pod \"cert-manager-55b4d954d5-z6r57\" (UID: \"97707089-c7e5-4235-a885-ff3991f2ef4f\") " pod="cert-manager/cert-manager-55b4d954d5-z6r57" Jul 08 00:14:39.669280 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.669193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97707089-c7e5-4235-a885-ff3991f2ef4f-bound-sa-token\") pod \"cert-manager-55b4d954d5-z6r57\" (UID: \"97707089-c7e5-4235-a885-ff3991f2ef4f\") " pod="cert-manager/cert-manager-55b4d954d5-z6r57" Jul 08 00:14:39.669280 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.669229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c22gl\" (UniqueName: \"kubernetes.io/projected/97707089-c7e5-4235-a885-ff3991f2ef4f-kube-api-access-c22gl\") pod \"cert-manager-55b4d954d5-z6r57\" (UID: \"97707089-c7e5-4235-a885-ff3991f2ef4f\") " pod="cert-manager/cert-manager-55b4d954d5-z6r57" Jul 08 00:14:39.677114 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.677080 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97707089-c7e5-4235-a885-ff3991f2ef4f-bound-sa-token\") pod \"cert-manager-55b4d954d5-z6r57\" (UID: \"97707089-c7e5-4235-a885-ff3991f2ef4f\") " pod="cert-manager/cert-manager-55b4d954d5-z6r57" Jul 08 00:14:39.677267 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.677235 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c22gl\" (UniqueName: \"kubernetes.io/projected/97707089-c7e5-4235-a885-ff3991f2ef4f-kube-api-access-c22gl\") pod \"cert-manager-55b4d954d5-z6r57\" (UID: \"97707089-c7e5-4235-a885-ff3991f2ef4f\") " pod="cert-manager/cert-manager-55b4d954d5-z6r57" Jul 08 00:14:39.693189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.693161 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-z6r57" Jul 08 00:14:39.820552 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:39.820368 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-z6r57"] Jul 08 00:14:39.823232 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:14:39.823202 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97707089_c7e5_4235_a885_ff3991f2ef4f.slice/crio-7928e06c0b08733d58dd217bd69d1794c3bca5730d61c0898c02c6576197c851 WatchSource:0}: Error finding container 7928e06c0b08733d58dd217bd69d1794c3bca5730d61c0898c02c6576197c851: Status 404 returned error can't find the container with id 7928e06c0b08733d58dd217bd69d1794c3bca5730d61c0898c02c6576197c851 Jul 08 00:14:40.419861 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:40.419828 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-z6r57" event={"ID":"97707089-c7e5-4235-a885-ff3991f2ef4f","Type":"ContainerStarted","Data":"3d56cf477cbd3dd2c7743b3855614ca7cc00790803c329b6d830540da7037e36"} Jul 08 00:14:40.420274 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:40.419873 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-z6r57" event={"ID":"97707089-c7e5-4235-a885-ff3991f2ef4f","Type":"ContainerStarted","Data":"7928e06c0b08733d58dd217bd69d1794c3bca5730d61c0898c02c6576197c851"} Jul 08 00:14:40.435704 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:40.435611 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-z6r57" podStartSLOduration=1.435592148 podStartE2EDuration="1.435592148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:14:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:14:40.435266229 +0000 UTC m=+282.914111483" watchObservedRunningTime="2026-07-08 00:14:40.435592148 +0000 UTC m=+282.914437402" Jul 08 00:14:42.665182 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:42.665088 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:42.772975 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:42.772937 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:44.674371 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.674338 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q"] Jul 08 00:14:44.715819 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.715782 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q"] Jul 08 00:14:44.715992 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.715893 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" Jul 08 00:14:44.719191 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.719156 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 00:14:44.719315 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.719207 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 00:14:44.719315 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.719286 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-59khh\"" Jul 08 00:14:44.815182 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.815142 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhmnw\" (UniqueName: \"kubernetes.io/projected/78bcfd08-94a6-478c-b1de-91a8a5eb949b-kube-api-access-mhmnw\") pod \"openshift-lws-operator-fd8ccff4c-tzt2q\" (UID: \"78bcfd08-94a6-478c-b1de-91a8a5eb949b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" Jul 08 00:14:44.815182 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.815188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78bcfd08-94a6-478c-b1de-91a8a5eb949b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tzt2q\" (UID: \"78bcfd08-94a6-478c-b1de-91a8a5eb949b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" Jul 08 00:14:44.915819 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.915776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhmnw\" (UniqueName: \"kubernetes.io/projected/78bcfd08-94a6-478c-b1de-91a8a5eb949b-kube-api-access-mhmnw\") pod \"openshift-lws-operator-fd8ccff4c-tzt2q\" (UID: \"78bcfd08-94a6-478c-b1de-91a8a5eb949b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" Jul 08 00:14:44.915992 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.915833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78bcfd08-94a6-478c-b1de-91a8a5eb949b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tzt2q\" (UID: \"78bcfd08-94a6-478c-b1de-91a8a5eb949b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" Jul 08 00:14:44.916192 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.916173 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78bcfd08-94a6-478c-b1de-91a8a5eb949b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tzt2q\" (UID: \"78bcfd08-94a6-478c-b1de-91a8a5eb949b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" Jul 08 00:14:44.923594 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:44.923564 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhmnw\" (UniqueName: \"kubernetes.io/projected/78bcfd08-94a6-478c-b1de-91a8a5eb949b-kube-api-access-mhmnw\") pod \"openshift-lws-operator-fd8ccff4c-tzt2q\" (UID: \"78bcfd08-94a6-478c-b1de-91a8a5eb949b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" Jul 08 00:14:45.024880 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:45.024778 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" Jul 08 00:14:45.176673 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:45.176596 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q"] Jul 08 00:14:45.179454 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:14:45.179426 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78bcfd08_94a6_478c_b1de_91a8a5eb949b.slice/crio-4fe76e04d56b005a997fad35cbf07157f07b1ac08875cae97f8c42d6685a3026 WatchSource:0}: Error finding container 4fe76e04d56b005a997fad35cbf07157f07b1ac08875cae97f8c42d6685a3026: Status 404 returned error can't find the container with id 4fe76e04d56b005a997fad35cbf07157f07b1ac08875cae97f8c42d6685a3026 Jul 08 00:14:45.443513 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:45.443475 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" event={"ID":"78bcfd08-94a6-478c-b1de-91a8a5eb949b","Type":"ContainerStarted","Data":"4fe76e04d56b005a997fad35cbf07157f07b1ac08875cae97f8c42d6685a3026"} Jul 08 00:14:48.458875 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:48.458840 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" event={"ID":"78bcfd08-94a6-478c-b1de-91a8a5eb949b","Type":"ContainerStarted","Data":"bc9722b41879d10838468129ceed283fa47ca7c7966e8113a4b3c5f72a9c6024"} Jul 08 00:14:48.476250 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:48.476192 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tzt2q" podStartSLOduration=2.037915874 podStartE2EDuration="4.476175229s" totalImagesPullingTime="2.438259355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:14:48.474362565 +0000 UTC m=+290.953207820" watchObservedRunningTime="2026-07-08 00:14:48.476175229 +0000 UTC m=+290.955020486" Jul 08 00:14:49.129793 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:49.129760 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:49.231212 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:49.231178 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:51.370975 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:51.370944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:14:52.514801 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.514770 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk"] Jul 08 00:14:52.517753 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.517736 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.520526 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.520503 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 00:14:52.520639 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.520511 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 00:14:52.521678 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.521660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lh9fh\"" Jul 08 00:14:52.527260 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.527238 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk"] Jul 08 00:14:52.580981 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.580947 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.581202 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.581011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.581202 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.581065 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2rv2\" (UniqueName: \"kubernetes.io/projected/ab38aa29-27d0-4cbe-92e6-db9a51499134-kube-api-access-b2rv2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.682076 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.682031 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.682303 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.682129 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.682303 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.682149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2rv2\" (UniqueName: \"kubernetes.io/projected/ab38aa29-27d0-4cbe-92e6-db9a51499134-kube-api-access-b2rv2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.682520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.682495 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.682520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.682512 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.691258 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.691229 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2rv2\" (UniqueName: \"kubernetes.io/projected/ab38aa29-27d0-4cbe-92e6-db9a51499134-kube-api-access-b2rv2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.828349 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.828307 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:52.959250 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:52.959222 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk"] Jul 08 00:14:52.961045 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:14:52.961018 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab38aa29_27d0_4cbe_92e6_db9a51499134.slice/crio-00ac1afbd11b76184e862a57d44ba182a0fb770933bffa1e2ca08e205292b2af WatchSource:0}: Error finding container 00ac1afbd11b76184e862a57d44ba182a0fb770933bffa1e2ca08e205292b2af: Status 404 returned error can't find the container with id 00ac1afbd11b76184e862a57d44ba182a0fb770933bffa1e2ca08e205292b2af Jul 08 00:14:53.481255 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:53.481220 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerID="5c2e6031aa4f93a7632163613b3226ef3b2ad4ba36ea23b6f0680af50ea58a69" exitCode=0 Jul 08 00:14:53.481424 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:53.481263 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" event={"ID":"ab38aa29-27d0-4cbe-92e6-db9a51499134","Type":"ContainerDied","Data":"5c2e6031aa4f93a7632163613b3226ef3b2ad4ba36ea23b6f0680af50ea58a69"} Jul 08 00:14:53.481424 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:53.481308 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" event={"ID":"ab38aa29-27d0-4cbe-92e6-db9a51499134","Type":"ContainerStarted","Data":"00ac1afbd11b76184e862a57d44ba182a0fb770933bffa1e2ca08e205292b2af"} Jul 08 00:14:54.487443 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:54.487348 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerID="02d7a451d1eda6b3dab95a1c8e5836b8ed3d40d8819f74708de63e8a46e719ae" exitCode=0 Jul 08 00:14:54.487838 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:54.487441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" event={"ID":"ab38aa29-27d0-4cbe-92e6-db9a51499134","Type":"ContainerDied","Data":"02d7a451d1eda6b3dab95a1c8e5836b8ed3d40d8819f74708de63e8a46e719ae"} Jul 08 00:14:55.493642 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:55.493597 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerID="7385ea2b98ee8e95edce01b6f43a5fc2722a3615c7a3513b8bd13fd3d637d54f" exitCode=0 Jul 08 00:14:55.493642 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:55.493645 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" event={"ID":"ab38aa29-27d0-4cbe-92e6-db9a51499134","Type":"ContainerDied","Data":"7385ea2b98ee8e95edce01b6f43a5fc2722a3615c7a3513b8bd13fd3d637d54f"} Jul 08 00:14:56.625822 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.625799 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:56.717337 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.717301 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-bundle\") pod \"ab38aa29-27d0-4cbe-92e6-db9a51499134\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " Jul 08 00:14:56.717337 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.717339 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-util\") pod \"ab38aa29-27d0-4cbe-92e6-db9a51499134\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " Jul 08 00:14:56.717541 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.717392 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2rv2\" (UniqueName: \"kubernetes.io/projected/ab38aa29-27d0-4cbe-92e6-db9a51499134-kube-api-access-b2rv2\") pod \"ab38aa29-27d0-4cbe-92e6-db9a51499134\" (UID: \"ab38aa29-27d0-4cbe-92e6-db9a51499134\") " Jul 08 00:14:56.718024 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.717993 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-bundle" (OuterVolumeSpecName: "bundle") pod "ab38aa29-27d0-4cbe-92e6-db9a51499134" (UID: "ab38aa29-27d0-4cbe-92e6-db9a51499134"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:14:56.719423 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.719398 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab38aa29-27d0-4cbe-92e6-db9a51499134-kube-api-access-b2rv2" (OuterVolumeSpecName: "kube-api-access-b2rv2") pod "ab38aa29-27d0-4cbe-92e6-db9a51499134" (UID: "ab38aa29-27d0-4cbe-92e6-db9a51499134"). InnerVolumeSpecName "kube-api-access-b2rv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:14:56.722544 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.722518 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-util" (OuterVolumeSpecName: "util") pod "ab38aa29-27d0-4cbe-92e6-db9a51499134" (UID: "ab38aa29-27d0-4cbe-92e6-db9a51499134"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:14:56.818082 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.818039 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-bundle\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:14:56.818082 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.818079 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab38aa29-27d0-4cbe-92e6-db9a51499134-util\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:14:56.818082 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:56.818091 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2rv2\" (UniqueName: \"kubernetes.io/projected/ab38aa29-27d0-4cbe-92e6-db9a51499134-kube-api-access-b2rv2\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:14:57.507346 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:57.507315 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" Jul 08 00:14:57.507346 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:57.507329 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgb4hk" event={"ID":"ab38aa29-27d0-4cbe-92e6-db9a51499134","Type":"ContainerDied","Data":"00ac1afbd11b76184e862a57d44ba182a0fb770933bffa1e2ca08e205292b2af"} Jul 08 00:14:57.507526 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:57.507375 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00ac1afbd11b76184e862a57d44ba182a0fb770933bffa1e2ca08e205292b2af" Jul 08 00:14:57.938299 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:14:57.938267 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 00:15:03.856393 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:03.856354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:04.860329 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.860292 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g"] Jul 08 00:15:04.860799 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.860737 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerName="pull" Jul 08 00:15:04.860799 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.860755 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerName="pull" Jul 08 00:15:04.860799 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.860770 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerName="extract" Jul 08 00:15:04.860799 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.860778 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerName="extract" Jul 08 00:15:04.860799 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.860793 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerName="util" Jul 08 00:15:04.860799 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.860801 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerName="util" Jul 08 00:15:04.861119 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.860889 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab38aa29-27d0-4cbe-92e6-db9a51499134" containerName="extract" Jul 08 00:15:04.862977 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.862957 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:04.865506 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.865482 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 00:15:04.865731 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.865707 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 00:15:04.865912 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.865745 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qshbf\"" Jul 08 00:15:04.866007 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.865987 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 00:15:04.866177 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.866156 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 00:15:04.884960 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.884926 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g"] Jul 08 00:15:04.987263 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.987225 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/197f9eeb-bb24-463b-8dfe-5425866fe41c-manifests\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:04.987437 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.987270 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/197f9eeb-bb24-463b-8dfe-5425866fe41c-webhook-cert\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:04.987437 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.987323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/197f9eeb-bb24-463b-8dfe-5425866fe41c-tmp\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:04.987437 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.987365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/197f9eeb-bb24-463b-8dfe-5425866fe41c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:04.987437 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:04.987415 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h77rx\" (UniqueName: \"kubernetes.io/projected/197f9eeb-bb24-463b-8dfe-5425866fe41c-kube-api-access-h77rx\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.088193 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.088160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/197f9eeb-bb24-463b-8dfe-5425866fe41c-manifests\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.088390 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.088202 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/197f9eeb-bb24-463b-8dfe-5425866fe41c-webhook-cert\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.088390 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.088231 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/197f9eeb-bb24-463b-8dfe-5425866fe41c-tmp\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.088390 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.088255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/197f9eeb-bb24-463b-8dfe-5425866fe41c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.088390 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.088279 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h77rx\" (UniqueName: \"kubernetes.io/projected/197f9eeb-bb24-463b-8dfe-5425866fe41c-kube-api-access-h77rx\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.088645 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.088620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/197f9eeb-bb24-463b-8dfe-5425866fe41c-manifests\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.090562 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.090534 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/197f9eeb-bb24-463b-8dfe-5425866fe41c-tmp\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.090795 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.090777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/197f9eeb-bb24-463b-8dfe-5425866fe41c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.090855 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.090798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/197f9eeb-bb24-463b-8dfe-5425866fe41c-webhook-cert\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.117329 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.117255 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h77rx\" (UniqueName: \"kubernetes.io/projected/197f9eeb-bb24-463b-8dfe-5425866fe41c-kube-api-access-h77rx\") pod \"opendatahub-operator-controller-manager-bdcc84df-vj47g\" (UID: \"197f9eeb-bb24-463b-8dfe-5425866fe41c\") " pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.173121 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.173059 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:05.317914 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.317883 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g"] Jul 08 00:15:05.319910 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:15:05.319885 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod197f9eeb_bb24_463b_8dfe_5425866fe41c.slice/crio-3183cd47b42908ceb76e1ed22dad6b58273b3002ac63b303c3bee59a55164a0d WatchSource:0}: Error finding container 3183cd47b42908ceb76e1ed22dad6b58273b3002ac63b303c3bee59a55164a0d: Status 404 returned error can't find the container with id 3183cd47b42908ceb76e1ed22dad6b58273b3002ac63b303c3bee59a55164a0d Jul 08 00:15:05.321619 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.321602 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 00:15:05.545664 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.545627 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" event={"ID":"197f9eeb-bb24-463b-8dfe-5425866fe41c","Type":"ContainerStarted","Data":"3183cd47b42908ceb76e1ed22dad6b58273b3002ac63b303c3bee59a55164a0d"} Jul 08 00:15:05.636128 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.636069 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:05.850438 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:05.850343 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:08.562257 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:08.562168 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" event={"ID":"197f9eeb-bb24-463b-8dfe-5425866fe41c","Type":"ContainerStarted","Data":"113eed681f8f41efac3ddf1c9ba8fbd95fe2d10f587fb01fbb5fbde2b0f82337"} Jul 08 00:15:09.568061 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:09.568027 2573 generic.go:356] "Generic (PLEG): container finished" podID="197f9eeb-bb24-463b-8dfe-5425866fe41c" containerID="113eed681f8f41efac3ddf1c9ba8fbd95fe2d10f587fb01fbb5fbde2b0f82337" exitCode=0 Jul 08 00:15:09.568492 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:09.568123 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" event={"ID":"197f9eeb-bb24-463b-8dfe-5425866fe41c","Type":"ContainerDied","Data":"113eed681f8f41efac3ddf1c9ba8fbd95fe2d10f587fb01fbb5fbde2b0f82337"} Jul 08 00:15:10.575615 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:10.575576 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" event={"ID":"197f9eeb-bb24-463b-8dfe-5425866fe41c","Type":"ContainerStarted","Data":"d1578067735356ebddbcbf60a74ebccc5d3a48f4d21cd7cc65851f428cd477af"} Jul 08 00:15:10.576134 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:10.575717 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:10.613831 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:10.613772 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" podStartSLOduration=2.234429153 podStartE2EDuration="6.613747775s" totalImagesPullingTime="3.279532431s" totalInitContainerRuntime="1.099786191s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:15:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:15:10.611947071 +0000 UTC m=+313.090792343" watchObservedRunningTime="2026-07-08 00:15:10.613747775 +0000 UTC m=+313.092593029" Jul 08 00:15:16.034250 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:16.034204 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:16.137148 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:16.137115 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:21.582764 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:21.582733 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bdcc84df-vj47g" Jul 08 00:15:24.008887 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.008845 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:24.118083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.118029 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:24.334488 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.334454 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:24.493955 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.493911 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56857954bd-bmnwm"] Jul 08 00:15:24.497932 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.497904 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.500747 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.500713 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 00:15:24.500900 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.500785 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 00:15:24.500900 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.500801 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 00:15:24.501156 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.501136 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 00:15:24.502350 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.502327 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p9d5l\"" Jul 08 00:15:24.512872 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.512841 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56857954bd-bmnwm"] Jul 08 00:15:24.639513 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.639421 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:24.652594 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.652561 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc53a85c-3a1b-4f2d-bda0-48bda127ab8d-tls-certs\") pod \"kube-auth-proxy-56857954bd-bmnwm\" (UID: \"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d\") " pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.652779 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.652608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxgrm\" (UniqueName: \"kubernetes.io/projected/dc53a85c-3a1b-4f2d-bda0-48bda127ab8d-kube-api-access-jxgrm\") pod \"kube-auth-proxy-56857954bd-bmnwm\" (UID: \"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d\") " pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.652779 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.652726 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc53a85c-3a1b-4f2d-bda0-48bda127ab8d-tmp\") pod \"kube-auth-proxy-56857954bd-bmnwm\" (UID: \"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d\") " pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.754134 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.754077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc53a85c-3a1b-4f2d-bda0-48bda127ab8d-tls-certs\") pod \"kube-auth-proxy-56857954bd-bmnwm\" (UID: \"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d\") " pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.754331 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.754141 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgrm\" (UniqueName: \"kubernetes.io/projected/dc53a85c-3a1b-4f2d-bda0-48bda127ab8d-kube-api-access-jxgrm\") pod \"kube-auth-proxy-56857954bd-bmnwm\" (UID: \"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d\") " pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.754331 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.754207 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc53a85c-3a1b-4f2d-bda0-48bda127ab8d-tmp\") pod \"kube-auth-proxy-56857954bd-bmnwm\" (UID: \"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d\") " pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.756482 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.756450 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc53a85c-3a1b-4f2d-bda0-48bda127ab8d-tmp\") pod \"kube-auth-proxy-56857954bd-bmnwm\" (UID: \"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d\") " pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.756761 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.756742 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc53a85c-3a1b-4f2d-bda0-48bda127ab8d-tls-certs\") pod \"kube-auth-proxy-56857954bd-bmnwm\" (UID: \"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d\") " pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.769757 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.769722 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgrm\" (UniqueName: \"kubernetes.io/projected/dc53a85c-3a1b-4f2d-bda0-48bda127ab8d-kube-api-access-jxgrm\") pod \"kube-auth-proxy-56857954bd-bmnwm\" (UID: \"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d\") " pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.809532 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.809495 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" Jul 08 00:15:24.859232 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.859202 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:24.960087 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.960048 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:24.972488 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:24.972459 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56857954bd-bmnwm"] Jul 08 00:15:24.974657 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:15:24.974625 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc53a85c_3a1b_4f2d_bda0_48bda127ab8d.slice/crio-fc6a7ebc7c8f81f30ccc9292b834c6e48da319372584a3462dcaf432a690ceaa WatchSource:0}: Error finding container fc6a7ebc7c8f81f30ccc9292b834c6e48da319372584a3462dcaf432a690ceaa: Status 404 returned error can't find the container with id fc6a7ebc7c8f81f30ccc9292b834c6e48da319372584a3462dcaf432a690ceaa Jul 08 00:15:25.059759 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.059720 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:25.646231 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.646193 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" event={"ID":"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d","Type":"ContainerStarted","Data":"fc6a7ebc7c8f81f30ccc9292b834c6e48da319372584a3462dcaf432a690ceaa"} Jul 08 00:15:25.713968 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.713933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:25.718108 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.718066 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7"] Jul 08 00:15:25.721523 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.721498 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.724544 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.724500 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j5njn\"" Jul 08 00:15:25.724879 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.724855 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 00:15:25.724990 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.724876 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 00:15:25.724990 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.724860 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 00:15:25.725135 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.725017 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 00:15:25.740422 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.740390 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7"] Jul 08 00:15:25.787221 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.787177 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:25.868809 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.868760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.869031 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.868831 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-token\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.869031 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.868874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4146bca-379d-4941-98fa-3b0d25400ea5-local-certs\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.869031 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.868921 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-cacerts\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.869031 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.868950 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.869031 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.868980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p85ns\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-kube-api-access-p85ns\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.869031 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.869011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.969760 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.969629 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.969760 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.969685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-token\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.969760 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.969738 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4146bca-379d-4941-98fa-3b0d25400ea5-local-certs\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.969760 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.969771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-cacerts\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.970124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.969796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.970124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.969871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p85ns\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-kube-api-access-p85ns\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.970124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.969926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.970772 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.970697 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.972487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.972458 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4146bca-379d-4941-98fa-3b0d25400ea5-local-certs\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.972657 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.972638 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-cacerts\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.973004 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.972980 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.973092 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.973033 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.980403 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.980375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-token\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.981071 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.981041 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p85ns\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-kube-api-access-p85ns\") pod \"istiod-openshift-gateway-7574459656-wbkm7\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:25.996696 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:25.996666 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:26.033726 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:26.033693 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:26.210410 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:26.210357 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7"] Jul 08 00:15:26.212527 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:15:26.212495 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4146bca_379d_4941_98fa_3b0d25400ea5.slice/crio-33d4d1aec35dab14c8fdc2d5bdbb4246dafabd4ae2621b59c68aec57a930e324 WatchSource:0}: Error finding container 33d4d1aec35dab14c8fdc2d5bdbb4246dafabd4ae2621b59c68aec57a930e324: Status 404 returned error can't find the container with id 33d4d1aec35dab14c8fdc2d5bdbb4246dafabd4ae2621b59c68aec57a930e324 Jul 08 00:15:26.635849 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:26.635815 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:26.653835 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:26.653797 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" event={"ID":"a4146bca-379d-4941-98fa-3b0d25400ea5","Type":"ContainerStarted","Data":"33d4d1aec35dab14c8fdc2d5bdbb4246dafabd4ae2621b59c68aec57a930e324"} Jul 08 00:15:29.489550 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:29.489504 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 00:15:29.489868 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:29.489640 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 00:15:29.673701 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:29.673643 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" event={"ID":"a4146bca-379d-4941-98fa-3b0d25400ea5","Type":"ContainerStarted","Data":"acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423"} Jul 08 00:15:29.673875 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:29.673835 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:29.675390 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:29.675360 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" event={"ID":"dc53a85c-3a1b-4f2d-bda0-48bda127ab8d","Type":"ContainerStarted","Data":"acf73e106f92cea083ecf9ba59f69c1cfe6402a9050fae6eeed272025cd6c4fe"} Jul 08 00:15:29.695549 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:29.695494 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" podStartSLOduration=1.4210719219999999 podStartE2EDuration="4.695478319s" totalImagesPullingTime="3.274406397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:15:29.693001466 +0000 UTC m=+332.171846721" watchObservedRunningTime="2026-07-08 00:15:29.695478319 +0000 UTC m=+332.174323573" Jul 08 00:15:29.711189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:29.711139 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56857954bd-bmnwm" podStartSLOduration=1.197567772 podStartE2EDuration="5.711120083s" totalImagesPullingTime="4.513552311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:15:29.709358007 +0000 UTC m=+332.188203261" watchObservedRunningTime="2026-07-08 00:15:29.711120083 +0000 UTC m=+332.189965337" Jul 08 00:15:30.024747 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:30.024700 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:30.124612 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:30.124573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:30.615976 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:30.615936 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:30.683549 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:30.683520 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:30.948336 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:30.948244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:31.671329 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:31.671290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:35.767915 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.767874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:35.825112 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.825064 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6"] Jul 08 00:15:35.828466 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.828439 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:35.832174 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.832147 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9cvll\"" Jul 08 00:15:35.832622 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.832603 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 08 00:15:35.836607 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.836587 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n"] Jul 08 00:15:35.840386 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.840362 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:35.840903 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.840879 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6"] Jul 08 00:15:35.843751 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.843732 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ggjnl\"" Jul 08 00:15:35.844752 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.844726 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 00:15:35.857086 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.857052 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n"] Jul 08 00:15:35.857432 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.857402 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h65m\" (UniqueName: \"kubernetes.io/projected/1c60a578-c233-444e-8bda-80bf5d7dced2-kube-api-access-6h65m\") pod \"llmisvc-controller-manager-777c6bd7d5-2mf8n\" (UID: \"1c60a578-c233-444e-8bda-80bf5d7dced2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:35.857648 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.857625 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c60a578-c233-444e-8bda-80bf5d7dced2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2mf8n\" (UID: \"1c60a578-c233-444e-8bda-80bf5d7dced2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:35.865565 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.865526 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:35.958186 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.958146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c60a578-c233-444e-8bda-80bf5d7dced2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2mf8n\" (UID: \"1c60a578-c233-444e-8bda-80bf5d7dced2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:35.958435 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:15:35.958384 2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 08 00:15:35.958686 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:15:35.958673 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c60a578-c233-444e-8bda-80bf5d7dced2-cert podName:1c60a578-c233-444e-8bda-80bf5d7dced2 nodeName:}" failed. No retries permitted until 2026-07-08 00:15:36.458649086 +0000 UTC m=+338.937494327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c60a578-c233-444e-8bda-80bf5d7dced2-cert") pod "llmisvc-controller-manager-777c6bd7d5-2mf8n" (UID: "1c60a578-c233-444e-8bda-80bf5d7dced2") : secret "llmisvc-webhook-server-cert" not found Jul 08 00:15:35.958787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.958571 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpfz5\" (UniqueName: \"kubernetes.io/projected/cef62655-35a5-4b8e-b3b8-8f89aabf7a59-kube-api-access-xpfz5\") pod \"kserve-controller-manager-d6f4b65b8-tgvq6\" (UID: \"cef62655-35a5-4b8e-b3b8-8f89aabf7a59\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:35.958904 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.958890 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h65m\" (UniqueName: \"kubernetes.io/projected/1c60a578-c233-444e-8bda-80bf5d7dced2-kube-api-access-6h65m\") pod \"llmisvc-controller-manager-777c6bd7d5-2mf8n\" (UID: \"1c60a578-c233-444e-8bda-80bf5d7dced2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:35.959015 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.959002 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cef62655-35a5-4b8e-b3b8-8f89aabf7a59-cert\") pod \"kserve-controller-manager-d6f4b65b8-tgvq6\" (UID: \"cef62655-35a5-4b8e-b3b8-8f89aabf7a59\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:35.975940 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:35.975897 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h65m\" (UniqueName: \"kubernetes.io/projected/1c60a578-c233-444e-8bda-80bf5d7dced2-kube-api-access-6h65m\") pod \"llmisvc-controller-manager-777c6bd7d5-2mf8n\" (UID: \"1c60a578-c233-444e-8bda-80bf5d7dced2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:36.060004 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.059966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cef62655-35a5-4b8e-b3b8-8f89aabf7a59-cert\") pod \"kserve-controller-manager-d6f4b65b8-tgvq6\" (UID: \"cef62655-35a5-4b8e-b3b8-8f89aabf7a59\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:36.060265 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.060072 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpfz5\" (UniqueName: \"kubernetes.io/projected/cef62655-35a5-4b8e-b3b8-8f89aabf7a59-kube-api-access-xpfz5\") pod \"kserve-controller-manager-d6f4b65b8-tgvq6\" (UID: \"cef62655-35a5-4b8e-b3b8-8f89aabf7a59\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:36.060265 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:15:36.060164 2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 08 00:15:36.060265 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:15:36.060244 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cef62655-35a5-4b8e-b3b8-8f89aabf7a59-cert podName:cef62655-35a5-4b8e-b3b8-8f89aabf7a59 nodeName:}" failed. No retries permitted until 2026-07-08 00:15:36.560228501 +0000 UTC m=+339.039073738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cef62655-35a5-4b8e-b3b8-8f89aabf7a59-cert") pod "kserve-controller-manager-d6f4b65b8-tgvq6" (UID: "cef62655-35a5-4b8e-b3b8-8f89aabf7a59") : secret "kserve-webhook-server-cert" not found Jul 08 00:15:36.083665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.083627 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpfz5\" (UniqueName: \"kubernetes.io/projected/cef62655-35a5-4b8e-b3b8-8f89aabf7a59-kube-api-access-xpfz5\") pod \"kserve-controller-manager-d6f4b65b8-tgvq6\" (UID: \"cef62655-35a5-4b8e-b3b8-8f89aabf7a59\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:36.135740 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.135697 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:36.463435 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.463343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c60a578-c233-444e-8bda-80bf5d7dced2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2mf8n\" (UID: \"1c60a578-c233-444e-8bda-80bf5d7dced2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:36.466136 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.465789 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c60a578-c233-444e-8bda-80bf5d7dced2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2mf8n\" (UID: \"1c60a578-c233-444e-8bda-80bf5d7dced2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:36.550858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.550818 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:36.564029 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.563997 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cef62655-35a5-4b8e-b3b8-8f89aabf7a59-cert\") pod \"kserve-controller-manager-d6f4b65b8-tgvq6\" (UID: \"cef62655-35a5-4b8e-b3b8-8f89aabf7a59\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:36.566428 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.566404 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cef62655-35a5-4b8e-b3b8-8f89aabf7a59-cert\") pod \"kserve-controller-manager-d6f4b65b8-tgvq6\" (UID: \"cef62655-35a5-4b8e-b3b8-8f89aabf7a59\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:36.740976 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.740870 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:36.752333 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.752306 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:36.939393 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:36.939360 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n"] Jul 08 00:15:36.941485 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:15:36.941457 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c60a578_c233_444e_8bda_80bf5d7dced2.slice/crio-823f2ceaaf5375624dcf450a525cd828607d2b8ad5cb35b426a50f0c99b1b9fb WatchSource:0}: Error finding container 823f2ceaaf5375624dcf450a525cd828607d2b8ad5cb35b426a50f0c99b1b9fb: Status 404 returned error can't find the container with id 823f2ceaaf5375624dcf450a525cd828607d2b8ad5cb35b426a50f0c99b1b9fb Jul 08 00:15:37.045190 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:37.045154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:37.152167 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:37.152139 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6"] Jul 08 00:15:37.154858 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:15:37.154826 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef62655_35a5_4b8e_b3b8_8f89aabf7a59.slice/crio-7ab15f345dc4f7b0c2072fc0f333b33585c58b8942ad1cbfb101c038fa6c6a05 WatchSource:0}: Error finding container 7ab15f345dc4f7b0c2072fc0f333b33585c58b8942ad1cbfb101c038fa6c6a05: Status 404 returned error can't find the container with id 7ab15f345dc4f7b0c2072fc0f333b33585c58b8942ad1cbfb101c038fa6c6a05 Jul 08 00:15:37.186665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:37.186635 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:37.258861 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:37.258820 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:37.720424 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:37.720389 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" event={"ID":"cef62655-35a5-4b8e-b3b8-8f89aabf7a59","Type":"ContainerStarted","Data":"7ab15f345dc4f7b0c2072fc0f333b33585c58b8942ad1cbfb101c038fa6c6a05"} Jul 08 00:15:37.721748 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:37.721717 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" event={"ID":"1c60a578-c233-444e-8bda-80bf5d7dced2","Type":"ContainerStarted","Data":"823f2ceaaf5375624dcf450a525cd828607d2b8ad5cb35b426a50f0c99b1b9fb"} Jul 08 00:15:39.204214 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.204177 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7"] Jul 08 00:15:39.204756 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.204400 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" podUID="a4146bca-379d-4941-98fa-3b0d25400ea5" containerName="discovery" containerID="cri-o://acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423" gracePeriod=30 Jul 08 00:15:39.490016 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.489985 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:39.589027 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.588987 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4146bca-379d-4941-98fa-3b0d25400ea5-local-certs\") pod \"a4146bca-379d-4941-98fa-3b0d25400ea5\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " Jul 08 00:15:39.589027 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.589048 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-cacerts\") pod \"a4146bca-379d-4941-98fa-3b0d25400ea5\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " Jul 08 00:15:39.589309 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.589073 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p85ns\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-kube-api-access-p85ns\") pod \"a4146bca-379d-4941-98fa-3b0d25400ea5\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " Jul 08 00:15:39.589309 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.589093 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-dns-cert\") pod \"a4146bca-379d-4941-98fa-3b0d25400ea5\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " Jul 08 00:15:39.589309 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.589154 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-kubeconfig\") pod \"a4146bca-379d-4941-98fa-3b0d25400ea5\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " Jul 08 00:15:39.589309 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.589303 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-token\") pod \"a4146bca-379d-4941-98fa-3b0d25400ea5\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " Jul 08 00:15:39.589517 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.589346 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-ca-configmap\") pod \"a4146bca-379d-4941-98fa-3b0d25400ea5\" (UID: \"a4146bca-379d-4941-98fa-3b0d25400ea5\") " Jul 08 00:15:39.589945 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.589886 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a4146bca-379d-4941-98fa-3b0d25400ea5" (UID: "a4146bca-379d-4941-98fa-3b0d25400ea5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:15:39.592115 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.592062 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4146bca-379d-4941-98fa-3b0d25400ea5-local-certs" (OuterVolumeSpecName: "local-certs") pod "a4146bca-379d-4941-98fa-3b0d25400ea5" (UID: "a4146bca-379d-4941-98fa-3b0d25400ea5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:15:39.592583 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.592556 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-cacerts" (OuterVolumeSpecName: "cacerts") pod "a4146bca-379d-4941-98fa-3b0d25400ea5" (UID: "a4146bca-379d-4941-98fa-3b0d25400ea5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:15:39.592583 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.592570 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4146bca-379d-4941-98fa-3b0d25400ea5" (UID: "a4146bca-379d-4941-98fa-3b0d25400ea5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:15:39.592764 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.592692 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a4146bca-379d-4941-98fa-3b0d25400ea5" (UID: "a4146bca-379d-4941-98fa-3b0d25400ea5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:15:39.592822 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.592799 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-kube-api-access-p85ns" (OuterVolumeSpecName: "kube-api-access-p85ns") pod "a4146bca-379d-4941-98fa-3b0d25400ea5" (UID: "a4146bca-379d-4941-98fa-3b0d25400ea5"). InnerVolumeSpecName "kube-api-access-p85ns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:15:39.593082 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.593050 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a4146bca-379d-4941-98fa-3b0d25400ea5" (UID: "a4146bca-379d-4941-98fa-3b0d25400ea5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:15:39.690278 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.690244 2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4146bca-379d-4941-98fa-3b0d25400ea5-local-certs\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:15:39.690278 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.690276 2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-cacerts\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:15:39.690278 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.690287 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p85ns\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-kube-api-access-p85ns\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:15:39.690520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.690300 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-dns-cert\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:15:39.690520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.690312 2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-kubeconfig\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:15:39.690520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.690323 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-token\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:15:39.690520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.690334 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4146bca-379d-4941-98fa-3b0d25400ea5-istio-csr-ca-configmap\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:15:39.735319 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.735236 2573 generic.go:356] "Generic (PLEG): container finished" podID="a4146bca-379d-4941-98fa-3b0d25400ea5" containerID="acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423" exitCode=0 Jul 08 00:15:39.735319 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.735301 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" Jul 08 00:15:39.735510 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.735327 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" event={"ID":"a4146bca-379d-4941-98fa-3b0d25400ea5","Type":"ContainerDied","Data":"acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423"} Jul 08 00:15:39.735510 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.735393 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7" event={"ID":"a4146bca-379d-4941-98fa-3b0d25400ea5","Type":"ContainerDied","Data":"33d4d1aec35dab14c8fdc2d5bdbb4246dafabd4ae2621b59c68aec57a930e324"} Jul 08 00:15:39.735510 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.735417 2573 scope.go:117] "RemoveContainer" containerID="acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423" Jul 08 00:15:39.762330 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.762294 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7"] Jul 08 00:15:39.765729 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:39.765701 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wbkm7"] Jul 08 00:15:40.098954 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:40.098915 2573 scope.go:117] "RemoveContainer" containerID="acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423" Jul 08 00:15:40.099357 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:15:40.099325 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423\": container with ID starting with acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423 not found: ID does not exist" containerID="acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423" Jul 08 00:15:40.099459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:40.099370 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423"} err="failed to get container status \"acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423\": rpc error: code = NotFound desc = could not find container \"acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423\": container with ID starting with acd6783fb7b8a3e8ddbe7a9b0b666a28f5733dcbb33c293a93a7724b3733b423 not found: ID does not exist" Jul 08 00:15:40.116987 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:40.116959 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4146bca-379d-4941-98fa-3b0d25400ea5" path="/var/lib/kubelet/pods/a4146bca-379d-4941-98fa-3b0d25400ea5/volumes" Jul 08 00:15:41.748072 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:41.748033 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" event={"ID":"1c60a578-c233-444e-8bda-80bf5d7dced2","Type":"ContainerStarted","Data":"59a6fb9b2a5fd7da98a6a7756e05af081fbdaa87aeeb76ac47209ef6d6f2a55b"} Jul 08 00:15:41.748517 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:41.748138 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:15:41.749629 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:41.749609 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" event={"ID":"cef62655-35a5-4b8e-b3b8-8f89aabf7a59","Type":"ContainerStarted","Data":"8e05142283b70ebe205f744d378a6e387dee8004b852a572925379caa854ce22"} Jul 08 00:15:41.749753 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:41.749734 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:15:41.766006 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:41.765952 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" podStartSLOduration=2.988059266 podStartE2EDuration="6.765933096s" totalImagesPullingTime="3.77787383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:15:41.76482652 +0000 UTC m=+344.243671779" watchObservedRunningTime="2026-07-08 00:15:41.765933096 +0000 UTC m=+344.244778349" Jul 08 00:15:41.786393 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:41.786334 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" podStartSLOduration=3.257103231 podStartE2EDuration="6.786316465s" totalImagesPullingTime="3.529213234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:15:41.784793658 +0000 UTC m=+344.263638912" watchObservedRunningTime="2026-07-08 00:15:41.786316465 +0000 UTC m=+344.265161718" Jul 08 00:15:55.439367 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:55.439288 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:55.491886 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:55.491850 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:57.209223 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:57.209189 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:15:57.309495 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:15:57.309450 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:16:05.490695 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:05.490655 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:16:05.542732 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:05.542695 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:16:12.756587 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:12.756555 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2mf8n" Jul 08 00:16:12.760039 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:12.760013 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tgvq6" Jul 08 00:16:25.458527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.458477 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:16:25.526724 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.526687 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:16:25.582532 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.582497 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgblp"] Jul 08 00:16:25.582858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.582844 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4146bca-379d-4941-98fa-3b0d25400ea5" containerName="discovery" Jul 08 00:16:25.582901 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.582861 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4146bca-379d-4941-98fa-3b0d25400ea5" containerName="discovery" Jul 08 00:16:25.582935 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.582928 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4146bca-379d-4941-98fa-3b0d25400ea5" containerName="discovery" Jul 08 00:16:25.584900 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.584873 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" Jul 08 00:16:25.587745 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.587716 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 00:16:25.587996 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.587722 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 00:16:25.589055 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.589034 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2cbbt\"" Jul 08 00:16:25.595006 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.594979 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgblp"] Jul 08 00:16:25.622286 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.622253 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:16:25.688685 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.688637 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs69h\" (UniqueName: \"kubernetes.io/projected/c8205b5f-3592-47f5-8126-b502456adada-kube-api-access-fs69h\") pod \"kuadrant-operator-catalog-zgblp\" (UID: \"c8205b5f-3592-47f5-8126-b502456adada\") " pod="kuadrant-system/kuadrant-operator-catalog-zgblp" Jul 08 00:16:25.789493 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.789463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs69h\" (UniqueName: \"kubernetes.io/projected/c8205b5f-3592-47f5-8126-b502456adada-kube-api-access-fs69h\") pod \"kuadrant-operator-catalog-zgblp\" (UID: \"c8205b5f-3592-47f5-8126-b502456adada\") " pod="kuadrant-system/kuadrant-operator-catalog-zgblp" Jul 08 00:16:25.797628 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.797605 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs69h\" (UniqueName: \"kubernetes.io/projected/c8205b5f-3592-47f5-8126-b502456adada-kube-api-access-fs69h\") pod \"kuadrant-operator-catalog-zgblp\" (UID: \"c8205b5f-3592-47f5-8126-b502456adada\") " pod="kuadrant-system/kuadrant-operator-catalog-zgblp" Jul 08 00:16:25.896592 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:25.896547 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" Jul 08 00:16:26.031274 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.031250 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgblp"] Jul 08 00:16:26.033627 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:16:26.033603 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8205b5f_3592_47f5_8126_b502456adada.slice/crio-957a91a113eb215385d8e0c7f19af5ba423614bab772018c9e76e9998fc943f1 WatchSource:0}: Error finding container 957a91a113eb215385d8e0c7f19af5ba423614bab772018c9e76e9998fc943f1: Status 404 returned error can't find the container with id 957a91a113eb215385d8e0c7f19af5ba423614bab772018c9e76e9998fc943f1 Jul 08 00:16:26.156537 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.156447 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgblp"] Jul 08 00:16:26.171768 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.171736 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkwsl"] Jul 08 00:16:26.174462 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.174447 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" Jul 08 00:16:26.182595 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.182567 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkwsl"] Jul 08 00:16:26.294333 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.294291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9hc5\" (UniqueName: \"kubernetes.io/projected/55543e66-2223-4105-91ad-bb5acd67b59a-kube-api-access-t9hc5\") pod \"kuadrant-operator-catalog-xkwsl\" (UID: \"55543e66-2223-4105-91ad-bb5acd67b59a\") " pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" Jul 08 00:16:26.394946 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.394910 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9hc5\" (UniqueName: \"kubernetes.io/projected/55543e66-2223-4105-91ad-bb5acd67b59a-kube-api-access-t9hc5\") pod \"kuadrant-operator-catalog-xkwsl\" (UID: \"55543e66-2223-4105-91ad-bb5acd67b59a\") " pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" Jul 08 00:16:26.408729 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.408654 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9hc5\" (UniqueName: \"kubernetes.io/projected/55543e66-2223-4105-91ad-bb5acd67b59a-kube-api-access-t9hc5\") pod \"kuadrant-operator-catalog-xkwsl\" (UID: \"55543e66-2223-4105-91ad-bb5acd67b59a\") " pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" Jul 08 00:16:26.484215 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.484174 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" Jul 08 00:16:26.621889 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.621860 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xkwsl"] Jul 08 00:16:26.623932 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:16:26.623902 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55543e66_2223_4105_91ad_bb5acd67b59a.slice/crio-99abf0d86235ecf3fb06bc8660bd2d1f40cc0f4fcc031121a030d583a7a8acb2 WatchSource:0}: Error finding container 99abf0d86235ecf3fb06bc8660bd2d1f40cc0f4fcc031121a030d583a7a8acb2: Status 404 returned error can't find the container with id 99abf0d86235ecf3fb06bc8660bd2d1f40cc0f4fcc031121a030d583a7a8acb2 Jul 08 00:16:26.973266 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.973233 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" event={"ID":"c8205b5f-3592-47f5-8126-b502456adada","Type":"ContainerStarted","Data":"957a91a113eb215385d8e0c7f19af5ba423614bab772018c9e76e9998fc943f1"} Jul 08 00:16:26.974485 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:26.974454 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" event={"ID":"55543e66-2223-4105-91ad-bb5acd67b59a","Type":"ContainerStarted","Data":"99abf0d86235ecf3fb06bc8660bd2d1f40cc0f4fcc031121a030d583a7a8acb2"} Jul 08 00:16:28.987863 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:28.987824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" event={"ID":"c8205b5f-3592-47f5-8126-b502456adada","Type":"ContainerStarted","Data":"536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803"} Jul 08 00:16:28.988341 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:28.987875 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" podUID="c8205b5f-3592-47f5-8126-b502456adada" containerName="registry-server" containerID="cri-o://536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803" gracePeriod=2 Jul 08 00:16:28.989392 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:28.989367 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" event={"ID":"55543e66-2223-4105-91ad-bb5acd67b59a","Type":"ContainerStarted","Data":"e13f743264cb8311848f348107a60f06f0b46ef6f7ace7890b37db4adb688ee6"} Jul 08 00:16:29.004319 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.004273 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" podStartSLOduration=1.780437262 podStartE2EDuration="4.004256285s" totalImagesPullingTime="2.223819023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:16:29.002570212 +0000 UTC m=+391.481415467" watchObservedRunningTime="2026-07-08 00:16:29.004256285 +0000 UTC m=+391.483101551" Jul 08 00:16:29.018309 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.018255 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" podStartSLOduration=1.381952508 podStartE2EDuration="3.018238971s" totalImagesPullingTime="1.636286463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:16:29.016982009 +0000 UTC m=+391.495827263" watchObservedRunningTime="2026-07-08 00:16:29.018238971 +0000 UTC m=+391.497084272" Jul 08 00:16:29.238677 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.238606 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" Jul 08 00:16:29.423944 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.423900 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs69h\" (UniqueName: \"kubernetes.io/projected/c8205b5f-3592-47f5-8126-b502456adada-kube-api-access-fs69h\") pod \"c8205b5f-3592-47f5-8126-b502456adada\" (UID: \"c8205b5f-3592-47f5-8126-b502456adada\") " Jul 08 00:16:29.426216 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.426185 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8205b5f-3592-47f5-8126-b502456adada-kube-api-access-fs69h" (OuterVolumeSpecName: "kube-api-access-fs69h") pod "c8205b5f-3592-47f5-8126-b502456adada" (UID: "c8205b5f-3592-47f5-8126-b502456adada"). InnerVolumeSpecName "kube-api-access-fs69h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:16:29.524658 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.524564 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs69h\" (UniqueName: \"kubernetes.io/projected/c8205b5f-3592-47f5-8126-b502456adada-kube-api-access-fs69h\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:29.996506 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.996467 2573 generic.go:356] "Generic (PLEG): container finished" podID="c8205b5f-3592-47f5-8126-b502456adada" containerID="536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803" exitCode=0 Jul 08 00:16:29.997007 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.996511 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" Jul 08 00:16:29.997007 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.996557 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" event={"ID":"c8205b5f-3592-47f5-8126-b502456adada","Type":"ContainerDied","Data":"536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803"} Jul 08 00:16:29.997007 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.996601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zgblp" event={"ID":"c8205b5f-3592-47f5-8126-b502456adada","Type":"ContainerDied","Data":"957a91a113eb215385d8e0c7f19af5ba423614bab772018c9e76e9998fc943f1"} Jul 08 00:16:29.997007 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:29.996626 2573 scope.go:117] "RemoveContainer" containerID="536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803" Jul 08 00:16:30.010703 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:30.010680 2573 scope.go:117] "RemoveContainer" containerID="536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803" Jul 08 00:16:30.011119 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:16:30.011050 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803\": container with ID starting with 536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803 not found: ID does not exist" containerID="536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803" Jul 08 00:16:30.011119 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:30.011086 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803"} err="failed to get container status \"536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803\": rpc error: code = NotFound desc = could not find container \"536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803\": container with ID starting with 536df5eff09cc9331e4dd86a2c28d46482c0a8587de22edf27c5ae14dfee9803 not found: ID does not exist" Jul 08 00:16:30.021735 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:30.021695 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgblp"] Jul 08 00:16:30.023371 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:30.023349 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zgblp"] Jul 08 00:16:30.116384 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:30.116348 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8205b5f-3592-47f5-8126-b502456adada" path="/var/lib/kubelet/pods/c8205b5f-3592-47f5-8126-b502456adada/volumes" Jul 08 00:16:36.484596 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:36.484564 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" Jul 08 00:16:36.485081 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:36.484623 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" Jul 08 00:16:36.508308 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:36.508272 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" Jul 08 00:16:37.053322 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:37.053290 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xkwsl" Jul 08 00:16:41.144749 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.144709 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8"] Jul 08 00:16:41.145147 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.145065 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8205b5f-3592-47f5-8126-b502456adada" containerName="registry-server" Jul 08 00:16:41.145147 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.145078 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8205b5f-3592-47f5-8126-b502456adada" containerName="registry-server" Jul 08 00:16:41.145224 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.145178 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8205b5f-3592-47f5-8126-b502456adada" containerName="registry-server" Jul 08 00:16:41.148599 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.148580 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.151405 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.151374 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nxz2p\"" Jul 08 00:16:41.157578 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.157551 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8"] Jul 08 00:16:41.219433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.219397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.219433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.219451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdcn\" (UniqueName: \"kubernetes.io/projected/d8b9e78a-c408-4089-bed2-5806afdb3784-kube-api-access-cmdcn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.219674 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.219550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.320230 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.320191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.320230 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.320234 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdcn\" (UniqueName: \"kubernetes.io/projected/d8b9e78a-c408-4089-bed2-5806afdb3784-kube-api-access-cmdcn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.320442 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.320306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.320652 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.320631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.320691 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.320662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.329761 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.329729 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdcn\" (UniqueName: \"kubernetes.io/projected/d8b9e78a-c408-4089-bed2-5806afdb3784-kube-api-access-cmdcn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.459052 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.458958 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:41.615863 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.615825 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8"] Jul 08 00:16:41.619135 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.619108 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.622194 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.622166 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8"] Jul 08 00:16:41.624209 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:16:41.624186 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b9e78a_c408_4089_bed2_5806afdb3784.slice/crio-c0758f05cffb4ae51c0606205539ab483de020271e215e7d26a1a20ceba0baff WatchSource:0}: Error finding container c0758f05cffb4ae51c0606205539ab483de020271e215e7d26a1a20ceba0baff: Status 404 returned error can't find the container with id c0758f05cffb4ae51c0606205539ab483de020271e215e7d26a1a20ceba0baff Jul 08 00:16:41.629753 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.629717 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2w7b\" (UniqueName: \"kubernetes.io/projected/7e17cef1-a2b8-452e-89f7-eba77530153a-kube-api-access-l2w7b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.629911 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.629805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.629911 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.629841 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.630221 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.630197 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8"] Jul 08 00:16:41.730687 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.730588 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2w7b\" (UniqueName: \"kubernetes.io/projected/7e17cef1-a2b8-452e-89f7-eba77530153a-kube-api-access-l2w7b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.730687 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.730647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.730687 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.730670 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.731042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.731024 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.731091 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.731073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.738941 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.738908 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2w7b\" (UniqueName: \"kubernetes.io/projected/7e17cef1-a2b8-452e-89f7-eba77530153a-kube-api-access-l2w7b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.936598 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.936559 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8"] Jul 08 00:16:41.939111 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.939080 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:41.939341 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.939322 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:41.949043 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:41.949016 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8"] Jul 08 00:16:42.032867 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.032820 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.033025 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.032899 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkvhk\" (UniqueName: \"kubernetes.io/projected/d7bcf882-4f93-4204-837c-5f75c8a43ccd-kube-api-access-lkvhk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.033025 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.032965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.062232 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.062202 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerID="8e1a40ac313a9f32d75d4513b70d99b30f069b15c42a7db9761f0576681c7045" exitCode=0 Jul 08 00:16:42.062404 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.062287 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" event={"ID":"d8b9e78a-c408-4089-bed2-5806afdb3784","Type":"ContainerDied","Data":"8e1a40ac313a9f32d75d4513b70d99b30f069b15c42a7db9761f0576681c7045"} Jul 08 00:16:42.062404 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.062351 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" event={"ID":"d8b9e78a-c408-4089-bed2-5806afdb3784","Type":"ContainerStarted","Data":"c0758f05cffb4ae51c0606205539ab483de020271e215e7d26a1a20ceba0baff"} Jul 08 00:16:42.080968 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.080937 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8"] Jul 08 00:16:42.083752 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:16:42.083721 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e17cef1_a2b8_452e_89f7_eba77530153a.slice/crio-0cf638bf8b1b85a04d95b2038f0a701db9dab6bd47ed5f0d413c833911b746dc WatchSource:0}: Error finding container 0cf638bf8b1b85a04d95b2038f0a701db9dab6bd47ed5f0d413c833911b746dc: Status 404 returned error can't find the container with id 0cf638bf8b1b85a04d95b2038f0a701db9dab6bd47ed5f0d413c833911b746dc Jul 08 00:16:42.134105 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.134075 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkvhk\" (UniqueName: \"kubernetes.io/projected/d7bcf882-4f93-4204-837c-5f75c8a43ccd-kube-api-access-lkvhk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.134272 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.134158 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.134272 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.134197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.134611 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.134588 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.134693 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.134599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.142087 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.142062 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkvhk\" (UniqueName: \"kubernetes.io/projected/d7bcf882-4f93-4204-837c-5f75c8a43ccd-kube-api-access-lkvhk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.249794 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.249705 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:42.340636 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.340600 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm"] Jul 08 00:16:42.344714 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.344688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.353669 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.353642 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm"] Jul 08 00:16:42.392473 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.392447 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8"] Jul 08 00:16:42.393849 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:16:42.393822 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bcf882_4f93_4204_837c_5f75c8a43ccd.slice/crio-f1d458b957b6b80bd8a152f361af5646a4cd046761bc4b77610689e24d94d3b8 WatchSource:0}: Error finding container f1d458b957b6b80bd8a152f361af5646a4cd046761bc4b77610689e24d94d3b8: Status 404 returned error can't find the container with id f1d458b957b6b80bd8a152f361af5646a4cd046761bc4b77610689e24d94d3b8 Jul 08 00:16:42.439224 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.439195 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz48d\" (UniqueName: \"kubernetes.io/projected/606179cc-c250-4f9e-a8dc-9a2f9ae61272-kube-api-access-xz48d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.439386 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.439239 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.439386 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.439334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.540054 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.540020 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz48d\" (UniqueName: \"kubernetes.io/projected/606179cc-c250-4f9e-a8dc-9a2f9ae61272-kube-api-access-xz48d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.540238 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.540071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.540238 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.540147 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.540525 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.540506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.540596 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.540530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.548815 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.548789 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz48d\" (UniqueName: \"kubernetes.io/projected/606179cc-c250-4f9e-a8dc-9a2f9ae61272-kube-api-access-xz48d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.660345 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.660286 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:42.797866 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:42.797835 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm"] Jul 08 00:16:42.860130 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:16:42.860067 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606179cc_c250_4f9e_a8dc_9a2f9ae61272.slice/crio-f7319753ee897e95e7b1094c275ed49a4b75d7d8eda928b37dc17a849bdf0f2e WatchSource:0}: Error finding container f7319753ee897e95e7b1094c275ed49a4b75d7d8eda928b37dc17a849bdf0f2e: Status 404 returned error can't find the container with id f7319753ee897e95e7b1094c275ed49a4b75d7d8eda928b37dc17a849bdf0f2e Jul 08 00:16:43.068511 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.068422 2573 generic.go:356] "Generic (PLEG): container finished" podID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerID="c0e8299876504679973d9549ba5884957e03f2b21faeeef13e22ec368b1acfe0" exitCode=0 Jul 08 00:16:43.068649 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.068511 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" event={"ID":"606179cc-c250-4f9e-a8dc-9a2f9ae61272","Type":"ContainerDied","Data":"c0e8299876504679973d9549ba5884957e03f2b21faeeef13e22ec368b1acfe0"} Jul 08 00:16:43.068649 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.068563 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" event={"ID":"606179cc-c250-4f9e-a8dc-9a2f9ae61272","Type":"ContainerStarted","Data":"f7319753ee897e95e7b1094c275ed49a4b75d7d8eda928b37dc17a849bdf0f2e"} Jul 08 00:16:43.070596 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.070573 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerID="260a8ec920d6048250d763ab5f7d619c99a473663240a4ac3e6970a6909aa3d9" exitCode=0 Jul 08 00:16:43.070715 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.070647 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" event={"ID":"d8b9e78a-c408-4089-bed2-5806afdb3784","Type":"ContainerDied","Data":"260a8ec920d6048250d763ab5f7d619c99a473663240a4ac3e6970a6909aa3d9"} Jul 08 00:16:43.072336 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.072311 2573 generic.go:356] "Generic (PLEG): container finished" podID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerID="6b5cfbbb103ae7d82ea1f351e5b0b5ba26597b3c1529a1b30fd8a632f08d1a01" exitCode=0 Jul 08 00:16:43.072649 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.072363 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" event={"ID":"d7bcf882-4f93-4204-837c-5f75c8a43ccd","Type":"ContainerDied","Data":"6b5cfbbb103ae7d82ea1f351e5b0b5ba26597b3c1529a1b30fd8a632f08d1a01"} Jul 08 00:16:43.072649 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.072416 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" event={"ID":"d7bcf882-4f93-4204-837c-5f75c8a43ccd","Type":"ContainerStarted","Data":"f1d458b957b6b80bd8a152f361af5646a4cd046761bc4b77610689e24d94d3b8"} Jul 08 00:16:43.073938 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.073919 2573 generic.go:356] "Generic (PLEG): container finished" podID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerID="3e372144915e49b8dadd74777755d080579d475df1c0a2af0fe43a080599c447" exitCode=0 Jul 08 00:16:43.074032 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.073968 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" event={"ID":"7e17cef1-a2b8-452e-89f7-eba77530153a","Type":"ContainerDied","Data":"3e372144915e49b8dadd74777755d080579d475df1c0a2af0fe43a080599c447"} Jul 08 00:16:43.074032 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:43.074008 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" event={"ID":"7e17cef1-a2b8-452e-89f7-eba77530153a","Type":"ContainerStarted","Data":"0cf638bf8b1b85a04d95b2038f0a701db9dab6bd47ed5f0d413c833911b746dc"} Jul 08 00:16:44.082815 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:44.082786 2573 generic.go:356] "Generic (PLEG): container finished" podID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerID="3e3b58cbab0bcfe1c959a0daafdaca997b8709c9c336ea670e43a78c4a6adfc3" exitCode=0 Jul 08 00:16:44.083194 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:44.082866 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" event={"ID":"606179cc-c250-4f9e-a8dc-9a2f9ae61272","Type":"ContainerDied","Data":"3e3b58cbab0bcfe1c959a0daafdaca997b8709c9c336ea670e43a78c4a6adfc3"} Jul 08 00:16:44.085585 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:44.085563 2573 generic.go:356] "Generic (PLEG): container finished" podID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerID="7e5833e7c8d0015a9238b83d6666491c3c3e262bfe9c6ef65add032c58deed0c" exitCode=0 Jul 08 00:16:44.085721 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:44.085626 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" event={"ID":"d8b9e78a-c408-4089-bed2-5806afdb3784","Type":"ContainerDied","Data":"7e5833e7c8d0015a9238b83d6666491c3c3e262bfe9c6ef65add032c58deed0c"} Jul 08 00:16:44.087595 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:44.087560 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" event={"ID":"d7bcf882-4f93-4204-837c-5f75c8a43ccd","Type":"ContainerStarted","Data":"f6560f06240af34e5dded3fdb9348a325eeabb310e0164621609b3c335822230"} Jul 08 00:16:44.089510 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:44.089488 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" event={"ID":"7e17cef1-a2b8-452e-89f7-eba77530153a","Type":"ContainerStarted","Data":"c08851ee2e4422bfe9eb87c2f6661313965d45c0f01796de8dbad35268a75fac"} Jul 08 00:16:45.096464 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.096431 2573 generic.go:356] "Generic (PLEG): container finished" podID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerID="f6560f06240af34e5dded3fdb9348a325eeabb310e0164621609b3c335822230" exitCode=0 Jul 08 00:16:45.096464 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.096455 2573 generic.go:356] "Generic (PLEG): container finished" podID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerID="e6164f68f6374d34fe6ec050fa62917c25dabafa203dfc5f53e0e959d5f7c6c6" exitCode=0 Jul 08 00:16:45.096975 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.096524 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" event={"ID":"d7bcf882-4f93-4204-837c-5f75c8a43ccd","Type":"ContainerDied","Data":"f6560f06240af34e5dded3fdb9348a325eeabb310e0164621609b3c335822230"} Jul 08 00:16:45.096975 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.096582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" event={"ID":"d7bcf882-4f93-4204-837c-5f75c8a43ccd","Type":"ContainerDied","Data":"e6164f68f6374d34fe6ec050fa62917c25dabafa203dfc5f53e0e959d5f7c6c6"} Jul 08 00:16:45.098710 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.098686 2573 generic.go:356] "Generic (PLEG): container finished" podID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerID="c08851ee2e4422bfe9eb87c2f6661313965d45c0f01796de8dbad35268a75fac" exitCode=0 Jul 08 00:16:45.098710 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.098709 2573 generic.go:356] "Generic (PLEG): container finished" podID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerID="b0960c8892ede61b797988b9bd5d055125b417872e1251f82c4e129687f57bf2" exitCode=0 Jul 08 00:16:45.098874 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.098765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" event={"ID":"7e17cef1-a2b8-452e-89f7-eba77530153a","Type":"ContainerDied","Data":"c08851ee2e4422bfe9eb87c2f6661313965d45c0f01796de8dbad35268a75fac"} Jul 08 00:16:45.098874 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.098814 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" event={"ID":"7e17cef1-a2b8-452e-89f7-eba77530153a","Type":"ContainerDied","Data":"b0960c8892ede61b797988b9bd5d055125b417872e1251f82c4e129687f57bf2"} Jul 08 00:16:45.100860 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.100835 2573 generic.go:356] "Generic (PLEG): container finished" podID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerID="d50b56f02c6d34ae92393cb63bef2be15c1194ea319e83193961ae5e545ec4e7" exitCode=0 Jul 08 00:16:45.100976 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.100864 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" event={"ID":"606179cc-c250-4f9e-a8dc-9a2f9ae61272","Type":"ContainerDied","Data":"d50b56f02c6d34ae92393cb63bef2be15c1194ea319e83193961ae5e545ec4e7"} Jul 08 00:16:45.235142 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.235114 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:45.261393 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.261362 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-bundle\") pod \"d8b9e78a-c408-4089-bed2-5806afdb3784\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " Jul 08 00:16:45.261563 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.261410 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-util\") pod \"d8b9e78a-c408-4089-bed2-5806afdb3784\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " Jul 08 00:16:45.261563 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.261459 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmdcn\" (UniqueName: \"kubernetes.io/projected/d8b9e78a-c408-4089-bed2-5806afdb3784-kube-api-access-cmdcn\") pod \"d8b9e78a-c408-4089-bed2-5806afdb3784\" (UID: \"d8b9e78a-c408-4089-bed2-5806afdb3784\") " Jul 08 00:16:45.262011 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.261980 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-bundle" (OuterVolumeSpecName: "bundle") pod "d8b9e78a-c408-4089-bed2-5806afdb3784" (UID: "d8b9e78a-c408-4089-bed2-5806afdb3784"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:16:45.263762 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.263731 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b9e78a-c408-4089-bed2-5806afdb3784-kube-api-access-cmdcn" (OuterVolumeSpecName: "kube-api-access-cmdcn") pod "d8b9e78a-c408-4089-bed2-5806afdb3784" (UID: "d8b9e78a-c408-4089-bed2-5806afdb3784"). InnerVolumeSpecName "kube-api-access-cmdcn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:16:45.266796 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.266759 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-util" (OuterVolumeSpecName: "util") pod "d8b9e78a-c408-4089-bed2-5806afdb3784" (UID: "d8b9e78a-c408-4089-bed2-5806afdb3784"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:16:45.362177 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.362052 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-bundle\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:45.362177 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.362086 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b9e78a-c408-4089-bed2-5806afdb3784-util\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:45.362177 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:45.362121 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmdcn\" (UniqueName: \"kubernetes.io/projected/d8b9e78a-c408-4089-bed2-5806afdb3784-kube-api-access-cmdcn\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:46.107802 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.107774 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" Jul 08 00:16:46.108219 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.107829 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8" event={"ID":"d8b9e78a-c408-4089-bed2-5806afdb3784","Type":"ContainerDied","Data":"c0758f05cffb4ae51c0606205539ab483de020271e215e7d26a1a20ceba0baff"} Jul 08 00:16:46.108219 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.107873 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0758f05cffb4ae51c0606205539ab483de020271e215e7d26a1a20ceba0baff" Jul 08 00:16:46.257754 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.257720 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:46.267847 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.267814 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-bundle\") pod \"7e17cef1-a2b8-452e-89f7-eba77530153a\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " Jul 08 00:16:46.268008 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.267886 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2w7b\" (UniqueName: \"kubernetes.io/projected/7e17cef1-a2b8-452e-89f7-eba77530153a-kube-api-access-l2w7b\") pod \"7e17cef1-a2b8-452e-89f7-eba77530153a\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " Jul 08 00:16:46.268008 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.267969 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-util\") pod \"7e17cef1-a2b8-452e-89f7-eba77530153a\" (UID: \"7e17cef1-a2b8-452e-89f7-eba77530153a\") " Jul 08 00:16:46.268405 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.268377 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-bundle" (OuterVolumeSpecName: "bundle") pod "7e17cef1-a2b8-452e-89f7-eba77530153a" (UID: "7e17cef1-a2b8-452e-89f7-eba77530153a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:16:46.272089 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.272051 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e17cef1-a2b8-452e-89f7-eba77530153a-kube-api-access-l2w7b" (OuterVolumeSpecName: "kube-api-access-l2w7b") pod "7e17cef1-a2b8-452e-89f7-eba77530153a" (UID: "7e17cef1-a2b8-452e-89f7-eba77530153a"). InnerVolumeSpecName "kube-api-access-l2w7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:16:46.275423 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.275384 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-util" (OuterVolumeSpecName: "util") pod "7e17cef1-a2b8-452e-89f7-eba77530153a" (UID: "7e17cef1-a2b8-452e-89f7-eba77530153a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:16:46.308183 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.308154 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:46.311360 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.311335 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:46.368725 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.368631 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-util\") pod \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " Jul 08 00:16:46.368725 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.368693 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkvhk\" (UniqueName: \"kubernetes.io/projected/d7bcf882-4f93-4204-837c-5f75c8a43ccd-kube-api-access-lkvhk\") pod \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " Jul 08 00:16:46.368964 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.368735 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-bundle\") pod \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " Jul 08 00:16:46.368964 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.368764 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-bundle\") pod \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " Jul 08 00:16:46.368964 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.368791 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz48d\" (UniqueName: \"kubernetes.io/projected/606179cc-c250-4f9e-a8dc-9a2f9ae61272-kube-api-access-xz48d\") pod \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\" (UID: \"606179cc-c250-4f9e-a8dc-9a2f9ae61272\") " Jul 08 00:16:46.368964 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.368826 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-util\") pod \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\" (UID: \"d7bcf882-4f93-4204-837c-5f75c8a43ccd\") " Jul 08 00:16:46.369203 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.369067 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2w7b\" (UniqueName: \"kubernetes.io/projected/7e17cef1-a2b8-452e-89f7-eba77530153a-kube-api-access-l2w7b\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:46.369203 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.369085 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-util\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:46.369203 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.369128 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e17cef1-a2b8-452e-89f7-eba77530153a-bundle\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:46.369375 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.369359 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-bundle" (OuterVolumeSpecName: "bundle") pod "606179cc-c250-4f9e-a8dc-9a2f9ae61272" (UID: "606179cc-c250-4f9e-a8dc-9a2f9ae61272"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:16:46.369548 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.369522 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-bundle" (OuterVolumeSpecName: "bundle") pod "d7bcf882-4f93-4204-837c-5f75c8a43ccd" (UID: "d7bcf882-4f93-4204-837c-5f75c8a43ccd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:16:46.370995 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.370974 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7bcf882-4f93-4204-837c-5f75c8a43ccd-kube-api-access-lkvhk" (OuterVolumeSpecName: "kube-api-access-lkvhk") pod "d7bcf882-4f93-4204-837c-5f75c8a43ccd" (UID: "d7bcf882-4f93-4204-837c-5f75c8a43ccd"). InnerVolumeSpecName "kube-api-access-lkvhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:16:46.371358 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.371331 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/606179cc-c250-4f9e-a8dc-9a2f9ae61272-kube-api-access-xz48d" (OuterVolumeSpecName: "kube-api-access-xz48d") pod "606179cc-c250-4f9e-a8dc-9a2f9ae61272" (UID: "606179cc-c250-4f9e-a8dc-9a2f9ae61272"). InnerVolumeSpecName "kube-api-access-xz48d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:16:46.374648 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.374609 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-util" (OuterVolumeSpecName: "util") pod "606179cc-c250-4f9e-a8dc-9a2f9ae61272" (UID: "606179cc-c250-4f9e-a8dc-9a2f9ae61272"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:16:46.375421 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.375399 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-util" (OuterVolumeSpecName: "util") pod "d7bcf882-4f93-4204-837c-5f75c8a43ccd" (UID: "d7bcf882-4f93-4204-837c-5f75c8a43ccd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:16:46.469705 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.469669 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz48d\" (UniqueName: \"kubernetes.io/projected/606179cc-c250-4f9e-a8dc-9a2f9ae61272-kube-api-access-xz48d\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:46.469705 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.469701 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-util\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:46.469907 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.469712 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-util\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:46.469907 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.469744 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkvhk\" (UniqueName: \"kubernetes.io/projected/d7bcf882-4f93-4204-837c-5f75c8a43ccd-kube-api-access-lkvhk\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:46.469907 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.469754 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/606179cc-c250-4f9e-a8dc-9a2f9ae61272-bundle\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:46.469907 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:46.469763 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bcf882-4f93-4204-837c-5f75c8a43ccd-bundle\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:16:47.115113 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:47.115070 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" Jul 08 00:16:47.115508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:47.115111 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm" event={"ID":"606179cc-c250-4f9e-a8dc-9a2f9ae61272","Type":"ContainerDied","Data":"f7319753ee897e95e7b1094c275ed49a4b75d7d8eda928b37dc17a849bdf0f2e"} Jul 08 00:16:47.115508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:47.115159 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7319753ee897e95e7b1094c275ed49a4b75d7d8eda928b37dc17a849bdf0f2e" Jul 08 00:16:47.117111 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:47.117070 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" event={"ID":"d7bcf882-4f93-4204-837c-5f75c8a43ccd","Type":"ContainerDied","Data":"f1d458b957b6b80bd8a152f361af5646a4cd046761bc4b77610689e24d94d3b8"} Jul 08 00:16:47.117260 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:47.117143 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1d458b957b6b80bd8a152f361af5646a4cd046761bc4b77610689e24d94d3b8" Jul 08 00:16:47.117260 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:47.117080 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8" Jul 08 00:16:47.119142 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:47.119110 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" event={"ID":"7e17cef1-a2b8-452e-89f7-eba77530153a","Type":"ContainerDied","Data":"0cf638bf8b1b85a04d95b2038f0a701db9dab6bd47ed5f0d413c833911b746dc"} Jul 08 00:16:47.119259 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:47.119151 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8" Jul 08 00:16:47.119259 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:47.119156 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cf638bf8b1b85a04d95b2038f0a701db9dab6bd47ed5f0d413c833911b746dc" Jul 08 00:16:53.787082 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:53.787051 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:16:57.018089 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018044 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t"] Jul 08 00:16:57.018628 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018584 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerName="extract" Jul 08 00:16:57.018628 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018605 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerName="extract" Jul 08 00:16:57.018628 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018625 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerName="util" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018634 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerName="util" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018650 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerName="util" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018659 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerName="util" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018670 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerName="pull" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018680 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerName="pull" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018690 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerName="pull" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018698 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerName="pull" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018709 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerName="extract" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018718 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerName="extract" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018731 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerName="pull" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018738 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerName="pull" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018759 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerName="extract" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018767 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerName="extract" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018778 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerName="pull" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018786 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerName="pull" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018798 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerName="util" Jul 08 00:16:57.018805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018806 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerName="util" Jul 08 00:16:57.019612 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018816 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerName="util" Jul 08 00:16:57.019612 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018824 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerName="util" Jul 08 00:16:57.019612 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018834 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerName="extract" Jul 08 00:16:57.019612 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018842 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerName="extract" Jul 08 00:16:57.019612 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018925 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7bcf882-4f93-4204-837c-5f75c8a43ccd" containerName="extract" Jul 08 00:16:57.019612 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018938 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e17cef1-a2b8-452e-89f7-eba77530153a" containerName="extract" Jul 08 00:16:57.019612 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018952 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b9e78a-c408-4089-bed2-5806afdb3784" containerName="extract" Jul 08 00:16:57.019612 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.018960 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="606179cc-c250-4f9e-a8dc-9a2f9ae61272" containerName="extract" Jul 08 00:16:57.021594 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.021569 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" Jul 08 00:16:57.024416 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.024394 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-rwzr5\"" Jul 08 00:16:57.024530 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.024423 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 08 00:16:57.032600 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.032569 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t"] Jul 08 00:16:57.062832 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.062786 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn6k6\" (UniqueName: \"kubernetes.io/projected/7193f0de-d80e-4198-9e6e-622a3336f06f-kube-api-access-cn6k6\") pod \"dns-operator-controller-manager-864dd78c4c-lv27t\" (UID: \"7193f0de-d80e-4198-9e6e-622a3336f06f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" Jul 08 00:16:57.163479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.163433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn6k6\" (UniqueName: \"kubernetes.io/projected/7193f0de-d80e-4198-9e6e-622a3336f06f-kube-api-access-cn6k6\") pod \"dns-operator-controller-manager-864dd78c4c-lv27t\" (UID: \"7193f0de-d80e-4198-9e6e-622a3336f06f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" Jul 08 00:16:57.177065 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.177026 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn6k6\" (UniqueName: \"kubernetes.io/projected/7193f0de-d80e-4198-9e6e-622a3336f06f-kube-api-access-cn6k6\") pod \"dns-operator-controller-manager-864dd78c4c-lv27t\" (UID: \"7193f0de-d80e-4198-9e6e-622a3336f06f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" Jul 08 00:16:57.333482 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.333443 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" Jul 08 00:16:57.475844 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:57.475815 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t"] Jul 08 00:16:57.477662 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:16:57.477634 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7193f0de_d80e_4198_9e6e_622a3336f06f.slice/crio-2db867e9af8451b7c1256f34404f74a1827b83edd1994ad79497a59aac59177b WatchSource:0}: Error finding container 2db867e9af8451b7c1256f34404f74a1827b83edd1994ad79497a59aac59177b: Status 404 returned error can't find the container with id 2db867e9af8451b7c1256f34404f74a1827b83edd1994ad79497a59aac59177b Jul 08 00:16:58.181909 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:58.181870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" event={"ID":"7193f0de-d80e-4198-9e6e-622a3336f06f","Type":"ContainerStarted","Data":"2db867e9af8451b7c1256f34404f74a1827b83edd1994ad79497a59aac59177b"} Jul 08 00:16:58.785828 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:58.785794 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:16:59.999325 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:16:59.999301 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 08 00:17:00.194761 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:00.194730 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" event={"ID":"7193f0de-d80e-4198-9e6e-622a3336f06f","Type":"ContainerStarted","Data":"6d8bfa054e5e2ed3cd65c5463c338354f4db821f5938ec202f305da3bbab583a"} Jul 08 00:17:00.194935 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:00.194840 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" Jul 08 00:17:00.213780 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:00.213724 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" podStartSLOduration=0.696752802 podStartE2EDuration="3.213710116s" totalImagesPullingTime="2.516957314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:17:00.210953375 +0000 UTC m=+422.689798628" watchObservedRunningTime="2026-07-08 00:17:00.213710116 +0000 UTC m=+422.692555425" Jul 08 00:17:01.300870 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.300832 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc"] Jul 08 00:17:01.303492 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.303475 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:01.306230 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.306206 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8s5sc\"" Jul 08 00:17:01.313026 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.313003 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc"] Jul 08 00:17:01.402582 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.402527 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-466rn\" (UniqueName: \"kubernetes.io/projected/680321ec-da6c-4610-9e21-4fcc692fe3bd-kube-api-access-466rn\") pod \"limitador-operator-controller-manager-859d7b78bd-qxlmc\" (UID: \"680321ec-da6c-4610-9e21-4fcc692fe3bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:01.503862 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.503817 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-466rn\" (UniqueName: \"kubernetes.io/projected/680321ec-da6c-4610-9e21-4fcc692fe3bd-kube-api-access-466rn\") pod \"limitador-operator-controller-manager-859d7b78bd-qxlmc\" (UID: \"680321ec-da6c-4610-9e21-4fcc692fe3bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:01.512197 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.512164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-466rn\" (UniqueName: \"kubernetes.io/projected/680321ec-da6c-4610-9e21-4fcc692fe3bd-kube-api-access-466rn\") pod \"limitador-operator-controller-manager-859d7b78bd-qxlmc\" (UID: \"680321ec-da6c-4610-9e21-4fcc692fe3bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:01.613867 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.613764 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:01.754060 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.754031 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc"] Jul 08 00:17:01.756248 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:17:01.756217 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680321ec_da6c_4610_9e21_4fcc692fe3bd.slice/crio-fda81841d661e27b82f9a3852e9464445f3b1615570fe313e3e684579c2ebe5e WatchSource:0}: Error finding container fda81841d661e27b82f9a3852e9464445f3b1615570fe313e3e684579c2ebe5e: Status 404 returned error can't find the container with id fda81841d661e27b82f9a3852e9464445f3b1615570fe313e3e684579c2ebe5e Jul 08 00:17:01.983166 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:01.983068 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:02.206522 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.206485 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" event={"ID":"680321ec-da6c-4610-9e21-4fcc692fe3bd","Type":"ContainerStarted","Data":"fda81841d661e27b82f9a3852e9464445f3b1615570fe313e3e684579c2ebe5e"} Jul 08 00:17:02.440788 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.440751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:02.641897 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.641858 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fcf6b9994-gggvx"] Jul 08 00:17:02.647042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.647006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.657863 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.657834 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fcf6b9994-gggvx"] Jul 08 00:17:02.699904 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.699807 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:02.715078 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.715039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-console-config\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.715295 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.715088 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn74c\" (UniqueName: \"kubernetes.io/projected/b3bac02b-5025-430a-b079-3b9c5c079038-kube-api-access-dn74c\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.715295 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.715156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-service-ca\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.715295 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.715180 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-trusted-ca-bundle\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.715295 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.715249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-oauth-serving-cert\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.715502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.715315 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3bac02b-5025-430a-b079-3b9c5c079038-console-serving-cert\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.715502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.715359 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3bac02b-5025-430a-b079-3b9c5c079038-console-oauth-config\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.798385 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.798323 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:02.816699 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.816651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn74c\" (UniqueName: \"kubernetes.io/projected/b3bac02b-5025-430a-b079-3b9c5c079038-kube-api-access-dn74c\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.816883 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.816711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-service-ca\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.816883 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.816751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-trusted-ca-bundle\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.816883 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.816788 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-oauth-serving-cert\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.816883 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.816861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3bac02b-5025-430a-b079-3b9c5c079038-console-serving-cert\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.817122 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.816906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3bac02b-5025-430a-b079-3b9c5c079038-console-oauth-config\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.817122 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.816933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-console-config\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.817616 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.817564 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-service-ca\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.817739 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.817651 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-console-config\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.817739 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.817711 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-oauth-serving-cert\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.818052 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.818010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3bac02b-5025-430a-b079-3b9c5c079038-trusted-ca-bundle\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.819934 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.819910 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3bac02b-5025-430a-b079-3b9c5c079038-console-oauth-config\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.820042 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.820027 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3bac02b-5025-430a-b079-3b9c5c079038-console-serving-cert\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.830728 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.830694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn74c\" (UniqueName: \"kubernetes.io/projected/b3bac02b-5025-430a-b079-3b9c5c079038-kube-api-access-dn74c\") pod \"console-fcf6b9994-gggvx\" (UID: \"b3bac02b-5025-430a-b079-3b9c5c079038\") " pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:02.898068 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.898031 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:02.959244 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:02.959148 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:03.001628 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:03.001593 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:03.106009 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:03.105984 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fcf6b9994-gggvx"] Jul 08 00:17:03.107455 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:17:03.107432 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bac02b_5025_430a_b079_3b9c5c079038.slice/crio-be065584f4ca5df69aaa727c23128144893a2025269d08f0acbb26f005187c9b WatchSource:0}: Error finding container be065584f4ca5df69aaa727c23128144893a2025269d08f0acbb26f005187c9b: Status 404 returned error can't find the container with id be065584f4ca5df69aaa727c23128144893a2025269d08f0acbb26f005187c9b Jul 08 00:17:03.215298 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:03.215202 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf6b9994-gggvx" event={"ID":"b3bac02b-5025-430a-b079-3b9c5c079038","Type":"ContainerStarted","Data":"de1570d2bc892361a2ebc769637ee038b600f2d561278485567993cfdca9681a"} Jul 08 00:17:03.215298 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:03.215260 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fcf6b9994-gggvx" event={"ID":"b3bac02b-5025-430a-b079-3b9c5c079038","Type":"ContainerStarted","Data":"be065584f4ca5df69aaa727c23128144893a2025269d08f0acbb26f005187c9b"} Jul 08 00:17:03.233581 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:03.233529 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fcf6b9994-gggvx" podStartSLOduration=1.233511449 podStartE2EDuration="1.233511449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:17:03.232483391 +0000 UTC m=+425.711328646" watchObservedRunningTime="2026-07-08 00:17:03.233511449 +0000 UTC m=+425.712356709" Jul 08 00:17:03.428811 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:03.428773 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:03.531737 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:03.531652 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:04.222466 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:04.222371 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" event={"ID":"680321ec-da6c-4610-9e21-4fcc692fe3bd","Type":"ContainerStarted","Data":"a51d9e314bba727a2665686ca0db20100d602319f87b3711b1c891bc10b77612"} Jul 08 00:17:04.222703 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:04.222685 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:04.248550 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:04.248492 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" podStartSLOduration=1.050758224 podStartE2EDuration="3.248475528s" totalImagesPullingTime="2.197717304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:17:04.247587252 +0000 UTC m=+426.726432523" watchObservedRunningTime="2026-07-08 00:17:04.248475528 +0000 UTC m=+426.727320782" Jul 08 00:17:04.435413 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:04.435375 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:07.002153 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.002110 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs"] Jul 08 00:17:07.004763 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.004742 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:07.011391 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.011373 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mq9k2\"" Jul 08 00:17:07.018644 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.018617 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs"] Jul 08 00:17:07.054268 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.054237 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" (UID: \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:07.054428 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.054275 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr92r\" (UniqueName: \"kubernetes.io/projected/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-kube-api-access-qr92r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" (UID: \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:07.155061 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.155016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" (UID: \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:07.155061 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.155062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr92r\" (UniqueName: \"kubernetes.io/projected/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-kube-api-access-qr92r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" (UID: \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:07.155495 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.155468 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" (UID: \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:07.165151 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.165120 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr92r\" (UniqueName: \"kubernetes.io/projected/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-kube-api-access-qr92r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" (UID: \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:07.314914 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.314874 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:07.459614 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.459588 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs"] Jul 08 00:17:07.461910 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:17:07.461882 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46655ef5_e3ac_48a7_b4c1_10bf69c69ea6.slice/crio-3dc6b71e16f7e7e8f8ea62c229238d0f072d9712b8302a0f9b92364159fa11d4 WatchSource:0}: Error finding container 3dc6b71e16f7e7e8f8ea62c229238d0f072d9712b8302a0f9b92364159fa11d4: Status 404 returned error can't find the container with id 3dc6b71e16f7e7e8f8ea62c229238d0f072d9712b8302a0f9b92364159fa11d4 Jul 08 00:17:07.791752 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:07.791726 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:08.246668 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:08.246579 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" event={"ID":"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6","Type":"ContainerStarted","Data":"3dc6b71e16f7e7e8f8ea62c229238d0f072d9712b8302a0f9b92364159fa11d4"} Jul 08 00:17:08.427518 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:08.427478 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:09.426633 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:09.426592 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:11.203668 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:11.203630 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lv27t" Jul 08 00:17:11.904912 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:11.904860 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dkssf"] Jul 08 00:17:11.907884 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:11.907862 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" Jul 08 00:17:11.910719 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:11.910693 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vh4db\"" Jul 08 00:17:11.925297 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:11.925263 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dkssf"] Jul 08 00:17:11.999403 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:11.999367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxmrj\" (UniqueName: \"kubernetes.io/projected/5f684df8-cff8-4360-9726-bde0f5fdb774-kube-api-access-hxmrj\") pod \"authorino-operator-75cc8d5cb7-dkssf\" (UID: \"5f684df8-cff8-4360-9726-bde0f5fdb774\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" Jul 08 00:17:12.099953 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:12.099914 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxmrj\" (UniqueName: \"kubernetes.io/projected/5f684df8-cff8-4360-9726-bde0f5fdb774-kube-api-access-hxmrj\") pod \"authorino-operator-75cc8d5cb7-dkssf\" (UID: \"5f684df8-cff8-4360-9726-bde0f5fdb774\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" Jul 08 00:17:12.113719 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:12.113689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxmrj\" (UniqueName: \"kubernetes.io/projected/5f684df8-cff8-4360-9726-bde0f5fdb774-kube-api-access-hxmrj\") pod \"authorino-operator-75cc8d5cb7-dkssf\" (UID: \"5f684df8-cff8-4360-9726-bde0f5fdb774\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" Jul 08 00:17:12.219668 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:12.219546 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" Jul 08 00:17:12.365159 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:12.365122 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dkssf"] Jul 08 00:17:12.366720 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:17:12.366688 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f684df8_cff8_4360_9726_bde0f5fdb774.slice/crio-f4ed1feed1577c8da42faa5184d7867a137933759719e545bb40422c2990c898 WatchSource:0}: Error finding container f4ed1feed1577c8da42faa5184d7867a137933759719e545bb40422c2990c898: Status 404 returned error can't find the container with id f4ed1feed1577c8da42faa5184d7867a137933759719e545bb40422c2990c898 Jul 08 00:17:12.959854 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:12.959816 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:12.960066 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:12.959882 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:12.966663 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:12.966623 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:13.288391 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:13.288346 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" event={"ID":"5f684df8-cff8-4360-9726-bde0f5fdb774","Type":"ContainerStarted","Data":"f4ed1feed1577c8da42faa5184d7867a137933759719e545bb40422c2990c898"} Jul 08 00:17:13.294028 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:13.294002 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fcf6b9994-gggvx" Jul 08 00:17:13.346270 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:13.346234 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789b4fbdbc-r7mw8"] Jul 08 00:17:13.431323 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:13.431276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:13.526471 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:13.526436 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:13.627313 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:13.627222 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:14.595606 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:14.595527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:14.694449 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:14.694413 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:15.231354 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:15.231322 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:16.310724 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:16.310683 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" event={"ID":"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6","Type":"ContainerStarted","Data":"dc8925e4b508be9fa477e2218d8650ef0bf94c7f43882a9f597ddeee7ec7521a"} Jul 08 00:17:16.311227 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:16.310782 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:16.312370 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:16.312338 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" event={"ID":"5f684df8-cff8-4360-9726-bde0f5fdb774","Type":"ContainerStarted","Data":"47a1f106016d790cd24b8299e79b1c2b0e729a9bc883aa903c8df76591f2c647"} Jul 08 00:17:16.312502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:16.312401 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" Jul 08 00:17:16.337360 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:16.337294 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" podStartSLOduration=1.898556256 podStartE2EDuration="10.337272571s" totalImagesPullingTime="8.438716315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:17:16.333352431 +0000 UTC m=+438.812197712" watchObservedRunningTime="2026-07-08 00:17:16.337272571 +0000 UTC m=+438.816117830" Jul 08 00:17:16.353773 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:16.353706 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" podStartSLOduration=1.830033302 podStartE2EDuration="5.353685431s" totalImagesPullingTime="3.523652129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:17:16.351289178 +0000 UTC m=+438.830134444" watchObservedRunningTime="2026-07-08 00:17:16.353685431 +0000 UTC m=+438.832530684" Jul 08 00:17:17.797232 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:17.797195 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:17.897078 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:17.897040 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:18.583663 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.583623 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll"] Jul 08 00:17:18.586371 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.586343 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:18.588872 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.588845 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:18.589061 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.589045 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 08 00:17:18.589152 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.589125 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nxz2p\"" Jul 08 00:17:18.589362 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.589347 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 08 00:17:18.594875 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.594416 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll"] Jul 08 00:17:18.663932 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.663888 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd4d2aee-9a36-445d-a684-371d175fd3ef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:18.664156 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.663937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fd4d2aee-9a36-445d-a684-371d175fd3ef-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:18.664156 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.664067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg2q4\" (UniqueName: \"kubernetes.io/projected/fd4d2aee-9a36-445d-a684-371d175fd3ef-kube-api-access-zg2q4\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:18.765499 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.765458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg2q4\" (UniqueName: \"kubernetes.io/projected/fd4d2aee-9a36-445d-a684-371d175fd3ef-kube-api-access-zg2q4\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:18.765695 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.765549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd4d2aee-9a36-445d-a684-371d175fd3ef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:18.765695 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.765585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fd4d2aee-9a36-445d-a684-371d175fd3ef-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:18.765816 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:18.765691 2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 08 00:17:18.765816 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:18.765764 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4d2aee-9a36-445d-a684-371d175fd3ef-plugin-serving-cert podName:fd4d2aee-9a36-445d-a684-371d175fd3ef nodeName:}" failed. No retries permitted until 2026-07-08 00:17:19.26574925 +0000 UTC m=+441.744594482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/fd4d2aee-9a36-445d-a684-371d175fd3ef-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-nwgll" (UID: "fd4d2aee-9a36-445d-a684-371d175fd3ef") : secret "plugin-serving-cert" not found Jul 08 00:17:18.766234 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.766216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fd4d2aee-9a36-445d-a684-371d175fd3ef-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:18.774158 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:18.774125 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg2q4\" (UniqueName: \"kubernetes.io/projected/fd4d2aee-9a36-445d-a684-371d175fd3ef-kube-api-access-zg2q4\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:19.042140 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:19.042081 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:19.270379 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:19.270338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd4d2aee-9a36-445d-a684-371d175fd3ef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:19.272722 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:19.272693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd4d2aee-9a36-445d-a684-371d175fd3ef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nwgll\" (UID: \"fd4d2aee-9a36-445d-a684-371d175fd3ef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:19.497797 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:19.497659 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" Jul 08 00:17:19.633164 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:19.633135 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll"] Jul 08 00:17:19.634725 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:17:19.634692 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd4d2aee_9a36_445d_a684_371d175fd3ef.slice/crio-d8545e9e7059fb6446003b557f0234f8ad107876701681539cfb81881a6bb224 WatchSource:0}: Error finding container d8545e9e7059fb6446003b557f0234f8ad107876701681539cfb81881a6bb224: Status 404 returned error can't find the container with id d8545e9e7059fb6446003b557f0234f8ad107876701681539cfb81881a6bb224 Jul 08 00:17:20.335206 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:20.335166 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" event={"ID":"fd4d2aee-9a36-445d-a684-371d175fd3ef","Type":"ContainerStarted","Data":"d8545e9e7059fb6446003b557f0234f8ad107876701681539cfb81881a6bb224"} Jul 08 00:17:22.384540 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:22.384480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:22.435845 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:22.435800 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:27.319761 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:27.319730 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:27.320263 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:27.319805 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkssf" Jul 08 00:17:28.454190 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.454141 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq"] Jul 08 00:17:28.457027 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.457004 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:28.474805 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.474772 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq"] Jul 08 00:17:28.553910 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.553874 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq"] Jul 08 00:17:28.554207 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:28.554187 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-9277n], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" podUID="1576b642-c0e4-4412-88f7-96a732cf1231" Jul 08 00:17:28.562916 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.562884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9277n\" (UniqueName: \"kubernetes.io/projected/1576b642-c0e4-4412-88f7-96a732cf1231-kube-api-access-9277n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" (UID: \"1576b642-c0e4-4412-88f7-96a732cf1231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:28.563127 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.562946 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1576b642-c0e4-4412-88f7-96a732cf1231-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" (UID: \"1576b642-c0e4-4412-88f7-96a732cf1231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:28.664281 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.664240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9277n\" (UniqueName: \"kubernetes.io/projected/1576b642-c0e4-4412-88f7-96a732cf1231-kube-api-access-9277n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" (UID: \"1576b642-c0e4-4412-88f7-96a732cf1231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:28.664477 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.664299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1576b642-c0e4-4412-88f7-96a732cf1231-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" (UID: \"1576b642-c0e4-4412-88f7-96a732cf1231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:28.664746 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.664724 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1576b642-c0e4-4412-88f7-96a732cf1231-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" (UID: \"1576b642-c0e4-4412-88f7-96a732cf1231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:28.673539 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:28.673506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9277n\" (UniqueName: \"kubernetes.io/projected/1576b642-c0e4-4412-88f7-96a732cf1231-kube-api-access-9277n\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" (UID: \"1576b642-c0e4-4412-88f7-96a732cf1231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:29.078246 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.078202 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq"] Jul 08 00:17:29.100254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.100215 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq"] Jul 08 00:17:29.120390 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.120353 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs"] Jul 08 00:17:29.120602 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.120579 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" containerName="manager" containerID="cri-o://dc8925e4b508be9fa477e2218d8650ef0bf94c7f43882a9f597ddeee7ec7521a" gracePeriod=2 Jul 08 00:17:29.136035 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.135999 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs"] Jul 08 00:17:29.137794 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.137746 2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\": pods \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:29.150584 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.150534 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp"] Jul 08 00:17:29.151151 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.151129 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" containerName="manager" Jul 08 00:17:29.151151 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.151151 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" containerName="manager" Jul 08 00:17:29.151317 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.151230 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" containerName="manager" Jul 08 00:17:29.153589 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.153553 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:29.154353 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.154124 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc"] Jul 08 00:17:29.154353 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.154332 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" containerName="manager" containerID="cri-o://a51d9e314bba727a2665686ca0db20100d602319f87b3711b1c891bc10b77612" gracePeriod=2 Jul 08 00:17:29.160312 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.160261 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc"] Jul 08 00:17:29.169762 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.169727 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp"] Jul 08 00:17:29.175197 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.175161 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r"] Jul 08 00:17:29.175670 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.175651 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" containerName="manager" Jul 08 00:17:29.175670 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.175671 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" containerName="manager" Jul 08 00:17:29.175840 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.175763 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" containerName="manager" Jul 08 00:17:29.178210 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.178184 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" Jul 08 00:17:29.190787 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.190667 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:29.192544 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.192513 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r"] Jul 08 00:17:29.193090 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.193056 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:29.216615 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.216576 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qxlmc\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:29.281783 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.281746 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ecb3d7-af3b-4876-851b-913757a02158-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8nrkp\" (UID: \"46ecb3d7-af3b-4876-851b-913757a02158\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:29.282167 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.282145 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2npv\" (UniqueName: \"kubernetes.io/projected/c0dca58c-925d-4daa-8453-ba9a6b195d25-kube-api-access-z2npv\") pod \"limitador-operator-controller-manager-859d7b78bd-27b9r\" (UID: \"c0dca58c-925d-4daa-8453-ba9a6b195d25\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" Jul 08 00:17:29.282357 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.282342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5rk8\" (UniqueName: \"kubernetes.io/projected/46ecb3d7-af3b-4876-851b-913757a02158-kube-api-access-n5rk8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8nrkp\" (UID: \"46ecb3d7-af3b-4876-851b-913757a02158\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:29.384051 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.383474 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5rk8\" (UniqueName: \"kubernetes.io/projected/46ecb3d7-af3b-4876-851b-913757a02158-kube-api-access-n5rk8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8nrkp\" (UID: \"46ecb3d7-af3b-4876-851b-913757a02158\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:29.384051 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.383586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ecb3d7-af3b-4876-851b-913757a02158-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8nrkp\" (UID: \"46ecb3d7-af3b-4876-851b-913757a02158\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:29.384051 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.383632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2npv\" (UniqueName: \"kubernetes.io/projected/c0dca58c-925d-4daa-8453-ba9a6b195d25-kube-api-access-z2npv\") pod \"limitador-operator-controller-manager-859d7b78bd-27b9r\" (UID: \"c0dca58c-925d-4daa-8453-ba9a6b195d25\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" Jul 08 00:17:29.384376 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.384274 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ecb3d7-af3b-4876-851b-913757a02158-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8nrkp\" (UID: \"46ecb3d7-af3b-4876-851b-913757a02158\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:29.399538 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.399348 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2npv\" (UniqueName: \"kubernetes.io/projected/c0dca58c-925d-4daa-8453-ba9a6b195d25-kube-api-access-z2npv\") pod \"limitador-operator-controller-manager-859d7b78bd-27b9r\" (UID: \"c0dca58c-925d-4daa-8453-ba9a6b195d25\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" Jul 08 00:17:29.400268 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.400126 2573 generic.go:356] "Generic (PLEG): container finished" podID="680321ec-da6c-4610-9e21-4fcc692fe3bd" containerID="a51d9e314bba727a2665686ca0db20100d602319f87b3711b1c891bc10b77612" exitCode=0 Jul 08 00:17:29.400715 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.400620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5rk8\" (UniqueName: \"kubernetes.io/projected/46ecb3d7-af3b-4876-851b-913757a02158-kube-api-access-n5rk8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8nrkp\" (UID: \"46ecb3d7-af3b-4876-851b-913757a02158\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:29.402444 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.402361 2573 generic.go:356] "Generic (PLEG): container finished" podID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" containerID="dc8925e4b508be9fa477e2218d8650ef0bf94c7f43882a9f597ddeee7ec7521a" exitCode=0 Jul 08 00:17:29.402590 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.402519 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:29.405360 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.405322 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qxlmc\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:29.407815 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.407638 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:29.409808 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.409763 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="1576b642-c0e4-4412-88f7-96a732cf1231" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:29.423011 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.422980 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:29.425533 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.425486 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qxlmc\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:29.427745 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.427671 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:29.429692 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.429664 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="1576b642-c0e4-4412-88f7-96a732cf1231" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:29.436044 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.436013 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:29.438594 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.438558 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qxlmc\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:29.440740 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.440711 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:29.442721 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.442690 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="1576b642-c0e4-4412-88f7-96a732cf1231" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:29.446550 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.446523 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:29.449042 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.449007 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qxlmc\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:29.451175 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.451139 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-j4tjs\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:29.453230 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:29.453199 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="1576b642-c0e4-4412-88f7-96a732cf1231" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:29.484881 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.484843 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1576b642-c0e4-4412-88f7-96a732cf1231-extensions-socket-volume\") pod \"1576b642-c0e4-4412-88f7-96a732cf1231\" (UID: \"1576b642-c0e4-4412-88f7-96a732cf1231\") " Jul 08 00:17:29.485424 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.484906 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr92r\" (UniqueName: \"kubernetes.io/projected/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-kube-api-access-qr92r\") pod \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\" (UID: \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\") " Jul 08 00:17:29.485424 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.484951 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9277n\" (UniqueName: \"kubernetes.io/projected/1576b642-c0e4-4412-88f7-96a732cf1231-kube-api-access-9277n\") pod \"1576b642-c0e4-4412-88f7-96a732cf1231\" (UID: \"1576b642-c0e4-4412-88f7-96a732cf1231\") " Jul 08 00:17:29.485424 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.484985 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-extensions-socket-volume\") pod \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\" (UID: \"46655ef5-e3ac-48a7-b4c1-10bf69c69ea6\") " Jul 08 00:17:29.485424 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.485032 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-466rn\" (UniqueName: \"kubernetes.io/projected/680321ec-da6c-4610-9e21-4fcc692fe3bd-kube-api-access-466rn\") pod \"680321ec-da6c-4610-9e21-4fcc692fe3bd\" (UID: \"680321ec-da6c-4610-9e21-4fcc692fe3bd\") " Jul 08 00:17:29.485424 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.485268 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1576b642-c0e4-4412-88f7-96a732cf1231-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1576b642-c0e4-4412-88f7-96a732cf1231" (UID: "1576b642-c0e4-4412-88f7-96a732cf1231"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:17:29.485424 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.485361 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1576b642-c0e4-4412-88f7-96a732cf1231-extensions-socket-volume\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:29.485750 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.485571 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" (UID: "46655ef5-e3ac-48a7-b4c1-10bf69c69ea6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:17:29.487559 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.487515 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-kube-api-access-qr92r" (OuterVolumeSpecName: "kube-api-access-qr92r") pod "46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" (UID: "46655ef5-e3ac-48a7-b4c1-10bf69c69ea6"). InnerVolumeSpecName "kube-api-access-qr92r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:17:29.487703 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.487549 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1576b642-c0e4-4412-88f7-96a732cf1231-kube-api-access-9277n" (OuterVolumeSpecName: "kube-api-access-9277n") pod "1576b642-c0e4-4412-88f7-96a732cf1231" (UID: "1576b642-c0e4-4412-88f7-96a732cf1231"). InnerVolumeSpecName "kube-api-access-9277n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:17:29.487816 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.487792 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/680321ec-da6c-4610-9e21-4fcc692fe3bd-kube-api-access-466rn" (OuterVolumeSpecName: "kube-api-access-466rn") pod "680321ec-da6c-4610-9e21-4fcc692fe3bd" (UID: "680321ec-da6c-4610-9e21-4fcc692fe3bd"). InnerVolumeSpecName "kube-api-access-466rn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:17:29.557956 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.557917 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:29.586621 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.586586 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr92r\" (UniqueName: \"kubernetes.io/projected/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-kube-api-access-qr92r\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:29.586621 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.586618 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9277n\" (UniqueName: \"kubernetes.io/projected/1576b642-c0e4-4412-88f7-96a732cf1231-kube-api-access-9277n\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:29.586621 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.586628 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6-extensions-socket-volume\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:29.586852 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.586637 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-466rn\" (UniqueName: \"kubernetes.io/projected/680321ec-da6c-4610-9e21-4fcc692fe3bd-kube-api-access-466rn\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:29.588573 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.588530 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" Jul 08 00:17:29.725280 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.725235 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp"] Jul 08 00:17:29.766558 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:29.766529 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r"] Jul 08 00:17:29.769381 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:17:29.769344 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0dca58c_925d_4daa_8453_ba9a6b195d25.slice/crio-f43d001b47d81f11b4a62bb3ffe35416e263e8909da2629adf0d29ea50727796 WatchSource:0}: Error finding container f43d001b47d81f11b4a62bb3ffe35416e263e8909da2629adf0d29ea50727796: Status 404 returned error can't find the container with id f43d001b47d81f11b4a62bb3ffe35416e263e8909da2629adf0d29ea50727796 Jul 08 00:17:30.116859 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.116778 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1576b642-c0e4-4412-88f7-96a732cf1231" path="/var/lib/kubelet/pods/1576b642-c0e4-4412-88f7-96a732cf1231/volumes" Jul 08 00:17:30.117064 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.117051 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46655ef5-e3ac-48a7-b4c1-10bf69c69ea6" path="/var/lib/kubelet/pods/46655ef5-e3ac-48a7-b4c1-10bf69c69ea6/volumes" Jul 08 00:17:30.117359 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.117347 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="680321ec-da6c-4610-9e21-4fcc692fe3bd" path="/var/lib/kubelet/pods/680321ec-da6c-4610-9e21-4fcc692fe3bd/volumes" Jul 08 00:17:30.412006 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.411908 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" event={"ID":"46ecb3d7-af3b-4876-851b-913757a02158","Type":"ContainerStarted","Data":"a2bbb2147cf4e80af8b223f4c042a61f9a2d22372e9f1c7f944f065b53ce88b2"} Jul 08 00:17:30.412006 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.411974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" event={"ID":"46ecb3d7-af3b-4876-851b-913757a02158","Type":"ContainerStarted","Data":"d94243e77119309504fa057250a755c9e6d90c6b2e1dc29f2a45cb3aeece899a"} Jul 08 00:17:30.412280 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.412191 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:30.413576 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.413556 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxlmc" Jul 08 00:17:30.413707 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.413554 2573 scope.go:117] "RemoveContainer" containerID="a51d9e314bba727a2665686ca0db20100d602319f87b3711b1c891bc10b77612" Jul 08 00:17:30.415571 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.415241 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-j4tjs" Jul 08 00:17:30.417738 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.417709 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:30.417858 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.417826 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" event={"ID":"c0dca58c-925d-4daa-8453-ba9a6b195d25","Type":"ContainerStarted","Data":"f55a104108b1db26860938f21ee362626f9e3cad0775a44ee369edf523f5bd42"} Jul 08 00:17:30.417926 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.417869 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" event={"ID":"c0dca58c-925d-4daa-8453-ba9a6b195d25","Type":"ContainerStarted","Data":"f43d001b47d81f11b4a62bb3ffe35416e263e8909da2629adf0d29ea50727796"} Jul 08 00:17:30.417926 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.417897 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" Jul 08 00:17:30.426083 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.426055 2573 scope.go:117] "RemoveContainer" containerID="dc8925e4b508be9fa477e2218d8650ef0bf94c7f43882a9f597ddeee7ec7521a" Jul 08 00:17:30.438350 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.438176 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" podStartSLOduration=1.438154518 podStartE2EDuration="1.438154518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:17:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:17:30.435887226 +0000 UTC m=+452.914732481" watchObservedRunningTime="2026-07-08 00:17:30.438154518 +0000 UTC m=+452.916999773" Jul 08 00:17:30.438496 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:30.438424 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xp7jq\" is forbidden: User \"system:node:ip-10-0-128-26.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-26.ec2.internal' and this object" podUID="1576b642-c0e4-4412-88f7-96a732cf1231" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xp7jq" Jul 08 00:17:30.466944 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:30.466889 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" podStartSLOduration=1.466873456 podStartE2EDuration="1.466873456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:17:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:17:30.46368822 +0000 UTC m=+452.942533497" watchObservedRunningTime="2026-07-08 00:17:30.466873456 +0000 UTC m=+452.945718710" Jul 08 00:17:32.602224 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:32.602182 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:32.729399 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:32.729340 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:35.137421 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:35.137374 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:35.241750 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:35.241703 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:37.959301 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:37.959265 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:38.056991 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:38.056957 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:38.381808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:38.381744 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-789b4fbdbc-r7mw8" podUID="71187a58-19d9-42ea-977a-c1bb66358a02" containerName="console" containerID="cri-o://ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295" gracePeriod=15 Jul 08 00:17:40.076265 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:40.076219 2573 patch_prober.go:28] interesting pod/console-789b4fbdbc-r7mw8 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Jul 08 00:17:40.076693 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:40.076292 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-789b4fbdbc-r7mw8" podUID="71187a58-19d9-42ea-977a-c1bb66358a02" containerName="console" probeResult="failure" output="Get \"https://10.132.0.21:8443/health\": dial tcp 10.132.0.21:8443: connect: connection refused" Jul 08 00:17:41.432117 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:41.432070 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-27b9r" Jul 08 00:17:41.432502 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:41.432328 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:41.490968 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:41.490928 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:41.591760 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:41.591728 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:45.937721 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:45.937694 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:17:46.047254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047227 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-oauth-serving-cert\") pod \"71187a58-19d9-42ea-977a-c1bb66358a02\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " Jul 08 00:17:46.047254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047267 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-trusted-ca-bundle\") pod \"71187a58-19d9-42ea-977a-c1bb66358a02\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " Jul 08 00:17:46.047516 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047294 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-oauth-config\") pod \"71187a58-19d9-42ea-977a-c1bb66358a02\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " Jul 08 00:17:46.047516 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047332 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-console-config\") pod \"71187a58-19d9-42ea-977a-c1bb66358a02\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " Jul 08 00:17:46.047516 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047359 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9mw9\" (UniqueName: \"kubernetes.io/projected/71187a58-19d9-42ea-977a-c1bb66358a02-kube-api-access-s9mw9\") pod \"71187a58-19d9-42ea-977a-c1bb66358a02\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " Jul 08 00:17:46.047516 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047410 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-service-ca\") pod \"71187a58-19d9-42ea-977a-c1bb66358a02\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " Jul 08 00:17:46.047516 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047460 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-serving-cert\") pod \"71187a58-19d9-42ea-977a-c1bb66358a02\" (UID: \"71187a58-19d9-42ea-977a-c1bb66358a02\") " Jul 08 00:17:46.047738 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047647 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "71187a58-19d9-42ea-977a-c1bb66358a02" (UID: "71187a58-19d9-42ea-977a-c1bb66358a02"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:17:46.047797 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047786 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-oauth-serving-cert\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:46.047967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047936 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "71187a58-19d9-42ea-977a-c1bb66358a02" (UID: "71187a58-19d9-42ea-977a-c1bb66358a02"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:17:46.047967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.047947 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-console-config" (OuterVolumeSpecName: "console-config") pod "71187a58-19d9-42ea-977a-c1bb66358a02" (UID: "71187a58-19d9-42ea-977a-c1bb66358a02"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:17:46.048337 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.048029 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-service-ca" (OuterVolumeSpecName: "service-ca") pod "71187a58-19d9-42ea-977a-c1bb66358a02" (UID: "71187a58-19d9-42ea-977a-c1bb66358a02"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:17:46.049781 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.049758 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71187a58-19d9-42ea-977a-c1bb66358a02-kube-api-access-s9mw9" (OuterVolumeSpecName: "kube-api-access-s9mw9") pod "71187a58-19d9-42ea-977a-c1bb66358a02" (UID: "71187a58-19d9-42ea-977a-c1bb66358a02"). InnerVolumeSpecName "kube-api-access-s9mw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:17:46.050051 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.050026 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "71187a58-19d9-42ea-977a-c1bb66358a02" (UID: "71187a58-19d9-42ea-977a-c1bb66358a02"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:17:46.050051 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.050041 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "71187a58-19d9-42ea-977a-c1bb66358a02" (UID: "71187a58-19d9-42ea-977a-c1bb66358a02"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:17:46.149022 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.148980 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-console-config\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:46.149022 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.149017 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9mw9\" (UniqueName: \"kubernetes.io/projected/71187a58-19d9-42ea-977a-c1bb66358a02-kube-api-access-s9mw9\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:46.149022 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.149028 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-service-ca\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:46.149255 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.149038 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-serving-cert\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:46.149255 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.149046 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71187a58-19d9-42ea-977a-c1bb66358a02-trusted-ca-bundle\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:46.149255 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.149054 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71187a58-19d9-42ea-977a-c1bb66358a02-console-oauth-config\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:46.536060 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.536026 2573 generic.go:356] "Generic (PLEG): container finished" podID="71187a58-19d9-42ea-977a-c1bb66358a02" containerID="ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295" exitCode=0 Jul 08 00:17:46.536274 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.536088 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789b4fbdbc-r7mw8" Jul 08 00:17:46.536274 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.536128 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789b4fbdbc-r7mw8" event={"ID":"71187a58-19d9-42ea-977a-c1bb66358a02","Type":"ContainerDied","Data":"ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295"} Jul 08 00:17:46.536274 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.536182 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789b4fbdbc-r7mw8" event={"ID":"71187a58-19d9-42ea-977a-c1bb66358a02","Type":"ContainerDied","Data":"70e43fe7c8f56d2821d1ccdc34d82dd1351d79a61f13e77bc3b684c52e79a0a0"} Jul 08 00:17:46.536274 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.536205 2573 scope.go:117] "RemoveContainer" containerID="ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295" Jul 08 00:17:46.538092 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.538061 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" event={"ID":"fd4d2aee-9a36-445d-a684-371d175fd3ef","Type":"ContainerStarted","Data":"a1f12211da82d49f68b0c1c60658fe7f8d888c102d3955813821b6b3b2a63669"} Jul 08 00:17:46.545743 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.545720 2573 scope.go:117] "RemoveContainer" containerID="ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295" Jul 08 00:17:46.546128 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:17:46.546079 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295\": container with ID starting with ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295 not found: ID does not exist" containerID="ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295" Jul 08 00:17:46.546207 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.546142 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295"} err="failed to get container status \"ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295\": rpc error: code = NotFound desc = could not find container \"ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295\": container with ID starting with ca90848febb1f1a58e7a48a7790f2ae9b196172f0f1c7c5d993ac52f41adc295 not found: ID does not exist" Jul 08 00:17:46.554736 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.554681 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nwgll" podStartSLOduration=2.336847989 podStartE2EDuration="28.554664316s" totalImagesPullingTime="26.217816327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:17:46.553216469 +0000 UTC m=+469.032061735" watchObservedRunningTime="2026-07-08 00:17:46.554664316 +0000 UTC m=+469.033509571" Jul 08 00:17:46.568682 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.568650 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789b4fbdbc-r7mw8"] Jul 08 00:17:46.573227 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:46.573194 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789b4fbdbc-r7mw8"] Jul 08 00:17:47.740472 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:47.740433 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp"] Jul 08 00:17:47.740967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:47.740687 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" podUID="46ecb3d7-af3b-4876-851b-913757a02158" containerName="manager" containerID="cri-o://a2bbb2147cf4e80af8b223f4c042a61f9a2d22372e9f1c7f944f065b53ce88b2" gracePeriod=10 Jul 08 00:17:47.967238 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:47.967194 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf"] Jul 08 00:17:47.967793 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:47.967773 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71187a58-19d9-42ea-977a-c1bb66358a02" containerName="console" Jul 08 00:17:47.967866 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:47.967797 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="71187a58-19d9-42ea-977a-c1bb66358a02" containerName="console" Jul 08 00:17:47.967926 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:47.967914 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="71187a58-19d9-42ea-977a-c1bb66358a02" containerName="console" Jul 08 00:17:48.027813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.027722 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf"] Jul 08 00:17:48.027813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.027735 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:17:48.117930 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.117897 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71187a58-19d9-42ea-977a-c1bb66358a02" path="/var/lib/kubelet/pods/71187a58-19d9-42ea-977a-c1bb66358a02/volumes" Jul 08 00:17:48.165049 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.165011 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td24k\" (UniqueName: \"kubernetes.io/projected/4c4cd3eb-27f0-4611-bc17-951d923aa085-kube-api-access-td24k\") pod \"kuadrant-operator-controller-manager-86878c769f-lk7rf\" (UID: \"4c4cd3eb-27f0-4611-bc17-951d923aa085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:17:48.165299 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.165153 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c4cd3eb-27f0-4611-bc17-951d923aa085-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lk7rf\" (UID: \"4c4cd3eb-27f0-4611-bc17-951d923aa085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:17:48.266531 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.266483 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td24k\" (UniqueName: \"kubernetes.io/projected/4c4cd3eb-27f0-4611-bc17-951d923aa085-kube-api-access-td24k\") pod \"kuadrant-operator-controller-manager-86878c769f-lk7rf\" (UID: \"4c4cd3eb-27f0-4611-bc17-951d923aa085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:17:48.266762 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.266611 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c4cd3eb-27f0-4611-bc17-951d923aa085-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lk7rf\" (UID: \"4c4cd3eb-27f0-4611-bc17-951d923aa085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:17:48.267056 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.267032 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c4cd3eb-27f0-4611-bc17-951d923aa085-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lk7rf\" (UID: \"4c4cd3eb-27f0-4611-bc17-951d923aa085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:17:48.274796 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.274754 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td24k\" (UniqueName: \"kubernetes.io/projected/4c4cd3eb-27f0-4611-bc17-951d923aa085-kube-api-access-td24k\") pod \"kuadrant-operator-controller-manager-86878c769f-lk7rf\" (UID: \"4c4cd3eb-27f0-4611-bc17-951d923aa085\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:17:48.338240 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.338201 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:17:48.512503 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.512459 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf"] Jul 08 00:17:48.515955 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:17:48.515904 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4cd3eb_27f0_4611_bc17_951d923aa085.slice/crio-dea73cf0a02265c478dd37df41f41ec67a0502843dbb68708ec8236dd2676e3b WatchSource:0}: Error finding container dea73cf0a02265c478dd37df41f41ec67a0502843dbb68708ec8236dd2676e3b: Status 404 returned error can't find the container with id dea73cf0a02265c478dd37df41f41ec67a0502843dbb68708ec8236dd2676e3b Jul 08 00:17:48.557662 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.557625 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" event={"ID":"4c4cd3eb-27f0-4611-bc17-951d923aa085","Type":"ContainerStarted","Data":"dea73cf0a02265c478dd37df41f41ec67a0502843dbb68708ec8236dd2676e3b"} Jul 08 00:17:48.559226 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.559200 2573 generic.go:356] "Generic (PLEG): container finished" podID="46ecb3d7-af3b-4876-851b-913757a02158" containerID="a2bbb2147cf4e80af8b223f4c042a61f9a2d22372e9f1c7f944f065b53ce88b2" exitCode=0 Jul 08 00:17:48.559384 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.559275 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" event={"ID":"46ecb3d7-af3b-4876-851b-913757a02158","Type":"ContainerDied","Data":"a2bbb2147cf4e80af8b223f4c042a61f9a2d22372e9f1c7f944f065b53ce88b2"} Jul 08 00:17:48.637701 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.637664 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:48.770946 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.770913 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5rk8\" (UniqueName: \"kubernetes.io/projected/46ecb3d7-af3b-4876-851b-913757a02158-kube-api-access-n5rk8\") pod \"46ecb3d7-af3b-4876-851b-913757a02158\" (UID: \"46ecb3d7-af3b-4876-851b-913757a02158\") " Jul 08 00:17:48.771345 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.771008 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ecb3d7-af3b-4876-851b-913757a02158-extensions-socket-volume\") pod \"46ecb3d7-af3b-4876-851b-913757a02158\" (UID: \"46ecb3d7-af3b-4876-851b-913757a02158\") " Jul 08 00:17:48.771406 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.771381 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46ecb3d7-af3b-4876-851b-913757a02158-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46ecb3d7-af3b-4876-851b-913757a02158" (UID: "46ecb3d7-af3b-4876-851b-913757a02158"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 00:17:48.773107 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.773077 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46ecb3d7-af3b-4876-851b-913757a02158-kube-api-access-n5rk8" (OuterVolumeSpecName: "kube-api-access-n5rk8") pod "46ecb3d7-af3b-4876-851b-913757a02158" (UID: "46ecb3d7-af3b-4876-851b-913757a02158"). InnerVolumeSpecName "kube-api-access-n5rk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:17:48.872110 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.872008 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5rk8\" (UniqueName: \"kubernetes.io/projected/46ecb3d7-af3b-4876-851b-913757a02158-kube-api-access-n5rk8\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:48.872110 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:48.872039 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46ecb3d7-af3b-4876-851b-913757a02158-extensions-socket-volume\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:17:49.568625 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:49.568591 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" event={"ID":"4c4cd3eb-27f0-4611-bc17-951d923aa085","Type":"ContainerStarted","Data":"8c970649d1ae05531bf18688120d01904212233e349971202193675e75013fd4"} Jul 08 00:17:49.568819 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:49.568700 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:17:49.570168 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:49.570145 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" Jul 08 00:17:49.570168 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:49.570153 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp" event={"ID":"46ecb3d7-af3b-4876-851b-913757a02158","Type":"ContainerDied","Data":"d94243e77119309504fa057250a755c9e6d90c6b2e1dc29f2a45cb3aeece899a"} Jul 08 00:17:49.570319 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:49.570210 2573 scope.go:117] "RemoveContainer" containerID="a2bbb2147cf4e80af8b223f4c042a61f9a2d22372e9f1c7f944f065b53ce88b2" Jul 08 00:17:49.594009 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:49.593932 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" podStartSLOduration=2.593913152 podStartE2EDuration="2.593913152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:17:49.59120294 +0000 UTC m=+472.070048213" watchObservedRunningTime="2026-07-08 00:17:49.593913152 +0000 UTC m=+472.072758473" Jul 08 00:17:49.613235 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:49.613189 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp"] Jul 08 00:17:49.617396 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:49.617365 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8nrkp"] Jul 08 00:17:50.116222 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:50.116192 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46ecb3d7-af3b-4876-851b-913757a02158" path="/var/lib/kubelet/pods/46ecb3d7-af3b-4876-851b-913757a02158/volumes" Jul 08 00:17:50.356134 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:50.356085 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:50.455896 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:50.455805 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:52.951477 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:52.951446 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:53.051864 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:53.051832 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:56.155720 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:56.155682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:56.255920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:56.255884 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:59.552608 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:59.552575 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:17:59.607967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:17:59.607933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:00.579388 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:00.579351 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lk7rf" Jul 08 00:18:04.152283 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:04.152243 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:04.649406 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:04.649369 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:08.150683 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.150649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:08.249003 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.248950 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:08.293757 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.293723 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gkqrw"] Jul 08 00:18:08.294128 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.294113 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ecb3d7-af3b-4876-851b-913757a02158" containerName="manager" Jul 08 00:18:08.294128 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.294128 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ecb3d7-af3b-4876-851b-913757a02158" containerName="manager" Jul 08 00:18:08.294235 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.294217 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="46ecb3d7-af3b-4876-851b-913757a02158" containerName="manager" Jul 08 00:18:08.310967 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.310935 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:08.334168 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.334136 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gkqrw"] Jul 08 00:18:08.334347 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.334238 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:08.337091 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.337065 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 00:18:08.390686 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.390644 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gkqrw"] Jul 08 00:18:08.405142 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.405031 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:08.456278 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.456230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62wpk\" (UniqueName: \"kubernetes.io/projected/07b476f1-2ee2-4236-99b1-da890a3e5d80-kube-api-access-62wpk\") pod \"limitador-limitador-64c94fd64f-gkqrw\" (UID: \"07b476f1-2ee2-4236-99b1-da890a3e5d80\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:08.456278 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.456285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07b476f1-2ee2-4236-99b1-da890a3e5d80-config-file\") pod \"limitador-limitador-64c94fd64f-gkqrw\" (UID: \"07b476f1-2ee2-4236-99b1-da890a3e5d80\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:08.511813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.511775 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:08.557532 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.557493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62wpk\" (UniqueName: \"kubernetes.io/projected/07b476f1-2ee2-4236-99b1-da890a3e5d80-kube-api-access-62wpk\") pod \"limitador-limitador-64c94fd64f-gkqrw\" (UID: \"07b476f1-2ee2-4236-99b1-da890a3e5d80\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:08.557532 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.557534 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07b476f1-2ee2-4236-99b1-da890a3e5d80-config-file\") pod \"limitador-limitador-64c94fd64f-gkqrw\" (UID: \"07b476f1-2ee2-4236-99b1-da890a3e5d80\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:08.558181 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.558162 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07b476f1-2ee2-4236-99b1-da890a3e5d80-config-file\") pod \"limitador-limitador-64c94fd64f-gkqrw\" (UID: \"07b476f1-2ee2-4236-99b1-da890a3e5d80\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:08.571485 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.571454 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62wpk\" (UniqueName: \"kubernetes.io/projected/07b476f1-2ee2-4236-99b1-da890a3e5d80-kube-api-access-62wpk\") pod \"limitador-limitador-64c94fd64f-gkqrw\" (UID: \"07b476f1-2ee2-4236-99b1-da890a3e5d80\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:08.645891 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.645856 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:08.810431 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.810374 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:08.847607 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.847566 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gkqrw"] Jul 08 00:18:08.849021 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:18:08.848991 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b476f1_2ee2_4236_99b1_da890a3e5d80.slice/crio-f8e403229185d882ae1384c20ec53629e2876474ea65c7ec415612c0efb4103c WatchSource:0}: Error finding container f8e403229185d882ae1384c20ec53629e2876474ea65c7ec415612c0efb4103c: Status 404 returned error can't find the container with id f8e403229185d882ae1384c20ec53629e2876474ea65c7ec415612c0efb4103c Jul 08 00:18:08.911257 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:08.911220 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:09.116287 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.116251 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tqz"] Jul 08 00:18:09.127837 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.127800 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:09.139435 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.139400 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tqz"] Jul 08 00:18:09.139622 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.139509 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m8tqz" Jul 08 00:18:09.142299 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.142280 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4l5nt\"" Jul 08 00:18:09.228884 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.228850 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:09.263766 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.263734 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckfqb\" (UniqueName: \"kubernetes.io/projected/767f4b5a-7cd7-4b7d-980f-ce0b2036a45d-kube-api-access-ckfqb\") pod \"authorino-75d556bd77-m8tqz\" (UID: \"767f4b5a-7cd7-4b7d-980f-ce0b2036a45d\") " pod="kuadrant-system/authorino-75d556bd77-m8tqz" Jul 08 00:18:09.364686 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.364644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckfqb\" (UniqueName: \"kubernetes.io/projected/767f4b5a-7cd7-4b7d-980f-ce0b2036a45d-kube-api-access-ckfqb\") pod \"authorino-75d556bd77-m8tqz\" (UID: \"767f4b5a-7cd7-4b7d-980f-ce0b2036a45d\") " pod="kuadrant-system/authorino-75d556bd77-m8tqz" Jul 08 00:18:09.375597 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.375516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckfqb\" (UniqueName: \"kubernetes.io/projected/767f4b5a-7cd7-4b7d-980f-ce0b2036a45d-kube-api-access-ckfqb\") pod \"authorino-75d556bd77-m8tqz\" (UID: \"767f4b5a-7cd7-4b7d-980f-ce0b2036a45d\") " pod="kuadrant-system/authorino-75d556bd77-m8tqz" Jul 08 00:18:09.449197 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.449158 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m8tqz" Jul 08 00:18:09.609405 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.609377 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tqz"] Jul 08 00:18:09.611018 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:18:09.610986 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod767f4b5a_7cd7_4b7d_980f_ce0b2036a45d.slice/crio-ed8c6312cdf43a4c304b8df00ced2b44362f68e61186da6b418f68fe5eca03ba WatchSource:0}: Error finding container ed8c6312cdf43a4c304b8df00ced2b44362f68e61186da6b418f68fe5eca03ba: Status 404 returned error can't find the container with id ed8c6312cdf43a4c304b8df00ced2b44362f68e61186da6b418f68fe5eca03ba Jul 08 00:18:09.687796 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.687692 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" event={"ID":"07b476f1-2ee2-4236-99b1-da890a3e5d80","Type":"ContainerStarted","Data":"f8e403229185d882ae1384c20ec53629e2876474ea65c7ec415612c0efb4103c"} Jul 08 00:18:09.689743 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:09.689679 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m8tqz" event={"ID":"767f4b5a-7cd7-4b7d-980f-ce0b2036a45d","Type":"ContainerStarted","Data":"ed8c6312cdf43a4c304b8df00ced2b44362f68e61186da6b418f68fe5eca03ba"} Jul 08 00:18:15.735012 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:15.734974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" event={"ID":"07b476f1-2ee2-4236-99b1-da890a3e5d80","Type":"ContainerStarted","Data":"6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9"} Jul 08 00:18:15.735408 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:15.735036 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:15.752046 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:15.752001 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" podStartSLOduration=1.009819546 podStartE2EDuration="7.751982091s" totalImagesPullingTime="6.742162545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:18:15.750587233 +0000 UTC m=+498.229432487" watchObservedRunningTime="2026-07-08 00:18:15.751982091 +0000 UTC m=+498.230827347" Jul 08 00:18:16.742730 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:16.742686 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m8tqz" event={"ID":"767f4b5a-7cd7-4b7d-980f-ce0b2036a45d","Type":"ContainerStarted","Data":"53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845"} Jul 08 00:18:16.757538 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:16.757424 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-m8tqz" podStartSLOduration=1.62142067 podStartE2EDuration="7.757407986s" totalImagesPullingTime="6.135987316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:18:16.75711462 +0000 UTC m=+499.235959870" watchObservedRunningTime="2026-07-08 00:18:16.757407986 +0000 UTC m=+499.236253269" Jul 08 00:18:25.087360 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.087316 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gkqrw"] Jul 08 00:18:25.087893 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.087622 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" podUID="07b476f1-2ee2-4236-99b1-da890a3e5d80" containerName="limitador" containerID="cri-o://6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9" gracePeriod=30 Jul 08 00:18:25.089684 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.089662 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:25.646459 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.646390 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:25.692882 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.692841 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62wpk\" (UniqueName: \"kubernetes.io/projected/07b476f1-2ee2-4236-99b1-da890a3e5d80-kube-api-access-62wpk\") pod \"07b476f1-2ee2-4236-99b1-da890a3e5d80\" (UID: \"07b476f1-2ee2-4236-99b1-da890a3e5d80\") " Jul 08 00:18:25.693059 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.692922 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07b476f1-2ee2-4236-99b1-da890a3e5d80-config-file\") pod \"07b476f1-2ee2-4236-99b1-da890a3e5d80\" (UID: \"07b476f1-2ee2-4236-99b1-da890a3e5d80\") " Jul 08 00:18:25.693340 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.693315 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07b476f1-2ee2-4236-99b1-da890a3e5d80-config-file" (OuterVolumeSpecName: "config-file") pod "07b476f1-2ee2-4236-99b1-da890a3e5d80" (UID: "07b476f1-2ee2-4236-99b1-da890a3e5d80"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:18:25.695139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.695118 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07b476f1-2ee2-4236-99b1-da890a3e5d80-kube-api-access-62wpk" (OuterVolumeSpecName: "kube-api-access-62wpk") pod "07b476f1-2ee2-4236-99b1-da890a3e5d80" (UID: "07b476f1-2ee2-4236-99b1-da890a3e5d80"). InnerVolumeSpecName "kube-api-access-62wpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:18:25.790961 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.790927 2573 generic.go:356] "Generic (PLEG): container finished" podID="07b476f1-2ee2-4236-99b1-da890a3e5d80" containerID="6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9" exitCode=0 Jul 08 00:18:25.791168 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.790980 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" Jul 08 00:18:25.791168 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.791012 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" event={"ID":"07b476f1-2ee2-4236-99b1-da890a3e5d80","Type":"ContainerDied","Data":"6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9"} Jul 08 00:18:25.791168 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.791074 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gkqrw" event={"ID":"07b476f1-2ee2-4236-99b1-da890a3e5d80","Type":"ContainerDied","Data":"f8e403229185d882ae1384c20ec53629e2876474ea65c7ec415612c0efb4103c"} Jul 08 00:18:25.791168 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.791127 2573 scope.go:117] "RemoveContainer" containerID="6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9" Jul 08 00:18:25.793566 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.793538 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62wpk\" (UniqueName: \"kubernetes.io/projected/07b476f1-2ee2-4236-99b1-da890a3e5d80-kube-api-access-62wpk\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:18:25.793566 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.793562 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/07b476f1-2ee2-4236-99b1-da890a3e5d80-config-file\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:18:25.801776 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.801753 2573 scope.go:117] "RemoveContainer" containerID="6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9" Jul 08 00:18:25.802126 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:18:25.802082 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9\": container with ID starting with 6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9 not found: ID does not exist" containerID="6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9" Jul 08 00:18:25.802182 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.802133 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9"} err="failed to get container status \"6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9\": rpc error: code = NotFound desc = could not find container \"6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9\": container with ID starting with 6708f8d9dbc24625910f96bcf74175a94f44d9b9a1489a7660d2f160a3b957c9 not found: ID does not exist" Jul 08 00:18:25.814475 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.814438 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gkqrw"] Jul 08 00:18:25.819961 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:25.819927 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gkqrw"] Jul 08 00:18:26.116912 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:26.116871 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07b476f1-2ee2-4236-99b1-da890a3e5d80" path="/var/lib/kubelet/pods/07b476f1-2ee2-4236-99b1-da890a3e5d80/volumes" Jul 08 00:18:27.148414 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.148366 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:27.242071 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.242039 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:27.617574 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.617522 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw"] Jul 08 00:18:27.618136 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.618118 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07b476f1-2ee2-4236-99b1-da890a3e5d80" containerName="limitador" Jul 08 00:18:27.618185 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.618140 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="07b476f1-2ee2-4236-99b1-da890a3e5d80" containerName="limitador" Jul 08 00:18:27.618272 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.618261 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="07b476f1-2ee2-4236-99b1-da890a3e5d80" containerName="limitador" Jul 08 00:18:27.623082 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.623056 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:27.626841 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.626812 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 00:18:27.627019 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.626987 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 08 00:18:27.628140 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.628123 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jsc86\"" Jul 08 00:18:27.628243 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.628208 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 00:18:27.636430 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.636403 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw"] Jul 08 00:18:27.696156 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.696122 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:27.710420 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.710378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d7c1f5d-9f48-44fc-a144-bdefdb2d591c-data\") pod \"postgres-69fb4594cf-gwpbw\" (UID: \"2d7c1f5d-9f48-44fc-a144-bdefdb2d591c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:27.710553 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.710460 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxc7\" (UniqueName: \"kubernetes.io/projected/2d7c1f5d-9f48-44fc-a144-bdefdb2d591c-kube-api-access-pzxc7\") pod \"postgres-69fb4594cf-gwpbw\" (UID: \"2d7c1f5d-9f48-44fc-a144-bdefdb2d591c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:27.810998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.810958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d7c1f5d-9f48-44fc-a144-bdefdb2d591c-data\") pod \"postgres-69fb4594cf-gwpbw\" (UID: \"2d7c1f5d-9f48-44fc-a144-bdefdb2d591c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:27.811233 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.811032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxc7\" (UniqueName: \"kubernetes.io/projected/2d7c1f5d-9f48-44fc-a144-bdefdb2d591c-kube-api-access-pzxc7\") pod \"postgres-69fb4594cf-gwpbw\" (UID: \"2d7c1f5d-9f48-44fc-a144-bdefdb2d591c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:27.811440 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.811415 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d7c1f5d-9f48-44fc-a144-bdefdb2d591c-data\") pod \"postgres-69fb4594cf-gwpbw\" (UID: \"2d7c1f5d-9f48-44fc-a144-bdefdb2d591c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:27.819798 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.819766 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxc7\" (UniqueName: \"kubernetes.io/projected/2d7c1f5d-9f48-44fc-a144-bdefdb2d591c-kube-api-access-pzxc7\") pod \"postgres-69fb4594cf-gwpbw\" (UID: \"2d7c1f5d-9f48-44fc-a144-bdefdb2d591c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:27.933627 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:27.933526 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:28.077998 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:28.077967 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw"] Jul 08 00:18:28.079931 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:18:28.079898 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7c1f5d_9f48_44fc_a144_bdefdb2d591c.slice/crio-4dba57328a9a388a709d0bedfb85fd9d43bc104aa9c7645b3f6ba4a3175633ca WatchSource:0}: Error finding container 4dba57328a9a388a709d0bedfb85fd9d43bc104aa9c7645b3f6ba4a3175633ca: Status 404 returned error can't find the container with id 4dba57328a9a388a709d0bedfb85fd9d43bc104aa9c7645b3f6ba4a3175633ca Jul 08 00:18:28.816342 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:28.816296 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" event={"ID":"2d7c1f5d-9f48-44fc-a144-bdefdb2d591c","Type":"ContainerStarted","Data":"4dba57328a9a388a709d0bedfb85fd9d43bc104aa9c7645b3f6ba4a3175633ca"} Jul 08 00:18:32.847643 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:32.847604 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" event={"ID":"2d7c1f5d-9f48-44fc-a144-bdefdb2d591c","Type":"ContainerStarted","Data":"7472727a721a23612ff0f817a84da244fa54e58b1a8ad09cd84125563a59a03d"} Jul 08 00:18:32.848061 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:32.847675 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:32.865002 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:32.864935 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" podStartSLOduration=1.202937233 podStartE2EDuration="5.864916802s" totalImagesPullingTime="4.661979569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:18:32.862880423 +0000 UTC m=+515.341725677" watchObservedRunningTime="2026-07-08 00:18:32.864916802 +0000 UTC m=+515.343762098" Jul 08 00:18:38.884246 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:38.884214 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gwpbw" Jul 08 00:18:39.057643 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.057609 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:39.212138 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.212044 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:39.312461 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.312423 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:39.730531 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.730487 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76ff99fbcf-bgrcn"] Jul 08 00:18:39.736687 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.736660 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:18:39.739287 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.739261 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 00:18:39.741501 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.741468 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76ff99fbcf-bgrcn"] Jul 08 00:18:39.823065 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.823022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fe959e4-3bda-420f-ba6d-c215a20e18f1-tls-cert\") pod \"authorino-76ff99fbcf-bgrcn\" (UID: \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\") " pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:18:39.823284 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.823131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drhpk\" (UniqueName: \"kubernetes.io/projected/1fe959e4-3bda-420f-ba6d-c215a20e18f1-kube-api-access-drhpk\") pod \"authorino-76ff99fbcf-bgrcn\" (UID: \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\") " pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:18:39.924624 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.924586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drhpk\" (UniqueName: \"kubernetes.io/projected/1fe959e4-3bda-420f-ba6d-c215a20e18f1-kube-api-access-drhpk\") pod \"authorino-76ff99fbcf-bgrcn\" (UID: \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\") " pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:18:39.925377 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.924662 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fe959e4-3bda-420f-ba6d-c215a20e18f1-tls-cert\") pod \"authorino-76ff99fbcf-bgrcn\" (UID: \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\") " pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:18:39.927317 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.927292 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fe959e4-3bda-420f-ba6d-c215a20e18f1-tls-cert\") pod \"authorino-76ff99fbcf-bgrcn\" (UID: \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\") " pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:18:39.932362 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:39.932333 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drhpk\" (UniqueName: \"kubernetes.io/projected/1fe959e4-3bda-420f-ba6d-c215a20e18f1-kube-api-access-drhpk\") pod \"authorino-76ff99fbcf-bgrcn\" (UID: \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\") " pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:18:40.047231 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:40.047199 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:18:40.186582 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:40.186553 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76ff99fbcf-bgrcn"] Jul 08 00:18:40.188463 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:18:40.188437 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fe959e4_3bda_420f_ba6d_c215a20e18f1.slice/crio-fd1f252186fa085a61ce1ee726460ec52acfab1ff4d1c55b3568051984834f62 WatchSource:0}: Error finding container fd1f252186fa085a61ce1ee726460ec52acfab1ff4d1c55b3568051984834f62: Status 404 returned error can't find the container with id fd1f252186fa085a61ce1ee726460ec52acfab1ff4d1c55b3568051984834f62 Jul 08 00:18:40.894627 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:40.894538 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" event={"ID":"1fe959e4-3bda-420f-ba6d-c215a20e18f1","Type":"ContainerStarted","Data":"7d6ff5709ad046ce97cc1b6475cc1232249d6da4a1d134aaa1f7f70187fbf0b2"} Jul 08 00:18:40.894627 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:40.894580 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" event={"ID":"1fe959e4-3bda-420f-ba6d-c215a20e18f1","Type":"ContainerStarted","Data":"fd1f252186fa085a61ce1ee726460ec52acfab1ff4d1c55b3568051984834f62"} Jul 08 00:18:40.913793 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:40.913729 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" podStartSLOduration=1.505269545 podStartE2EDuration="1.913711331s" totalImagesPullingTime="408.441786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:18:40.910277387 +0000 UTC m=+523.389122639" watchObservedRunningTime="2026-07-08 00:18:40.913711331 +0000 UTC m=+523.392556584" Jul 08 00:18:40.938168 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:40.938135 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tqz"] Jul 08 00:18:40.938634 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:40.938337 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-m8tqz" podUID="767f4b5a-7cd7-4b7d-980f-ce0b2036a45d" containerName="authorino" containerID="cri-o://53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845" gracePeriod=30 Jul 08 00:18:41.212388 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.212356 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m8tqz" Jul 08 00:18:41.336906 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.336866 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckfqb\" (UniqueName: \"kubernetes.io/projected/767f4b5a-7cd7-4b7d-980f-ce0b2036a45d-kube-api-access-ckfqb\") pod \"767f4b5a-7cd7-4b7d-980f-ce0b2036a45d\" (UID: \"767f4b5a-7cd7-4b7d-980f-ce0b2036a45d\") " Jul 08 00:18:41.338961 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.338935 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/767f4b5a-7cd7-4b7d-980f-ce0b2036a45d-kube-api-access-ckfqb" (OuterVolumeSpecName: "kube-api-access-ckfqb") pod "767f4b5a-7cd7-4b7d-980f-ce0b2036a45d" (UID: "767f4b5a-7cd7-4b7d-980f-ce0b2036a45d"). InnerVolumeSpecName "kube-api-access-ckfqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:18:41.438005 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.437967 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckfqb\" (UniqueName: \"kubernetes.io/projected/767f4b5a-7cd7-4b7d-980f-ce0b2036a45d-kube-api-access-ckfqb\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:18:41.901715 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.901678 2573 generic.go:356] "Generic (PLEG): container finished" podID="767f4b5a-7cd7-4b7d-980f-ce0b2036a45d" containerID="53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845" exitCode=0 Jul 08 00:18:41.901937 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.901723 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m8tqz" Jul 08 00:18:41.901937 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.901722 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m8tqz" event={"ID":"767f4b5a-7cd7-4b7d-980f-ce0b2036a45d","Type":"ContainerDied","Data":"53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845"} Jul 08 00:18:41.901937 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.901774 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m8tqz" event={"ID":"767f4b5a-7cd7-4b7d-980f-ce0b2036a45d","Type":"ContainerDied","Data":"ed8c6312cdf43a4c304b8df00ced2b44362f68e61186da6b418f68fe5eca03ba"} Jul 08 00:18:41.901937 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.901796 2573 scope.go:117] "RemoveContainer" containerID="53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845" Jul 08 00:18:41.911996 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.911972 2573 scope.go:117] "RemoveContainer" containerID="53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845" Jul 08 00:18:41.912328 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:18:41.912310 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845\": container with ID starting with 53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845 not found: ID does not exist" containerID="53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845" Jul 08 00:18:41.912380 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.912340 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845"} err="failed to get container status \"53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845\": rpc error: code = NotFound desc = could not find container \"53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845\": container with ID starting with 53be0ddcbcf3da56643bd8af716cce3cdaf43bcec5a373060562835a071c0845 not found: ID does not exist" Jul 08 00:18:41.925055 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.925018 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tqz"] Jul 08 00:18:41.930269 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:41.930238 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m8tqz"] Jul 08 00:18:42.116497 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:42.116463 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="767f4b5a-7cd7-4b7d-980f-ce0b2036a45d" path="/var/lib/kubelet/pods/767f4b5a-7cd7-4b7d-980f-ce0b2036a45d/volumes" Jul 08 00:18:45.306565 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.306528 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59b4bfc564-rpvc2"] Jul 08 00:18:45.307063 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.306855 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:45.307063 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.306920 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767f4b5a-7cd7-4b7d-980f-ce0b2036a45d" containerName="authorino" Jul 08 00:18:45.307063 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.306932 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="767f4b5a-7cd7-4b7d-980f-ce0b2036a45d" containerName="authorino" Jul 08 00:18:45.307063 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.307016 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="767f4b5a-7cd7-4b7d-980f-ce0b2036a45d" containerName="authorino" Jul 08 00:18:45.397785 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.397742 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:45.462211 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.462172 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:45.464890 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.464849 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b4bfc564-rpvc2"] Jul 08 00:18:45.465026 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.464969 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.466911 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.466884 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7887d4f798-7dmhj"] Jul 08 00:18:45.474606 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.469051 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 00:18:45.474606 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.469733 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 00:18:45.474606 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.469818 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g2vlt\"" Jul 08 00:18:45.495544 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.495510 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7887d4f798-7dmhj"] Jul 08 00:18:45.495724 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.495654 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.576351 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.576254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab50a784-8c28-44b1-85d8-fff6881b35af-webhook-cert\") pod \"maas-controller-59b4bfc564-rpvc2\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.576351 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.576309 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50a784-8c28-44b1-85d8-fff6881b35af-service-ca\") pod \"maas-controller-59b4bfc564-rpvc2\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.576549 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.576396 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skljh\" (UniqueName: \"kubernetes.io/projected/ab50a784-8c28-44b1-85d8-fff6881b35af-kube-api-access-skljh\") pod \"maas-controller-59b4bfc564-rpvc2\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.576549 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.576431 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05f3b024-0257-49f7-9bda-122e0610452c-service-ca\") pod \"maas-controller-7887d4f798-7dmhj\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.576549 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.576454 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dm7b\" (UniqueName: \"kubernetes.io/projected/05f3b024-0257-49f7-9bda-122e0610452c-kube-api-access-7dm7b\") pod \"maas-controller-7887d4f798-7dmhj\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.576549 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.576529 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05f3b024-0257-49f7-9bda-122e0610452c-webhook-cert\") pod \"maas-controller-7887d4f798-7dmhj\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.677837 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.677796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05f3b024-0257-49f7-9bda-122e0610452c-webhook-cert\") pod \"maas-controller-7887d4f798-7dmhj\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.678015 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.677875 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab50a784-8c28-44b1-85d8-fff6881b35af-webhook-cert\") pod \"maas-controller-59b4bfc564-rpvc2\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.678056 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.678032 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50a784-8c28-44b1-85d8-fff6881b35af-service-ca\") pod \"maas-controller-59b4bfc564-rpvc2\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.678138 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.678122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skljh\" (UniqueName: \"kubernetes.io/projected/ab50a784-8c28-44b1-85d8-fff6881b35af-kube-api-access-skljh\") pod \"maas-controller-59b4bfc564-rpvc2\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.678185 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.678155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05f3b024-0257-49f7-9bda-122e0610452c-service-ca\") pod \"maas-controller-7887d4f798-7dmhj\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.678237 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.678184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dm7b\" (UniqueName: \"kubernetes.io/projected/05f3b024-0257-49f7-9bda-122e0610452c-kube-api-access-7dm7b\") pod \"maas-controller-7887d4f798-7dmhj\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.678800 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.678770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50a784-8c28-44b1-85d8-fff6881b35af-service-ca\") pod \"maas-controller-59b4bfc564-rpvc2\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.678920 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.678826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05f3b024-0257-49f7-9bda-122e0610452c-service-ca\") pod \"maas-controller-7887d4f798-7dmhj\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.680505 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.680482 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05f3b024-0257-49f7-9bda-122e0610452c-webhook-cert\") pod \"maas-controller-7887d4f798-7dmhj\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.680608 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.680597 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab50a784-8c28-44b1-85d8-fff6881b35af-webhook-cert\") pod \"maas-controller-59b4bfc564-rpvc2\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.687060 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.687029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dm7b\" (UniqueName: \"kubernetes.io/projected/05f3b024-0257-49f7-9bda-122e0610452c-kube-api-access-7dm7b\") pod \"maas-controller-7887d4f798-7dmhj\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.687218 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.687083 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skljh\" (UniqueName: \"kubernetes.io/projected/ab50a784-8c28-44b1-85d8-fff6881b35af-kube-api-access-skljh\") pod \"maas-controller-59b4bfc564-rpvc2\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.781613 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.781578 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:45.807062 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.807013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:45.990329 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:45.990294 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59b4bfc564-rpvc2"] Jul 08 00:18:45.991988 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:18:45.991952 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab50a784_8c28_44b1_85d8_fff6881b35af.slice/crio-27b3fde0b03ab02cd4a0ddb661879050913ba470f34843d95936ad2594bf5e87 WatchSource:0}: Error finding container 27b3fde0b03ab02cd4a0ddb661879050913ba470f34843d95936ad2594bf5e87: Status 404 returned error can't find the container with id 27b3fde0b03ab02cd4a0ddb661879050913ba470f34843d95936ad2594bf5e87 Jul 08 00:18:46.050934 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:46.050908 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7887d4f798-7dmhj"] Jul 08 00:18:46.053064 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:18:46.053037 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f3b024_0257_49f7_9bda_122e0610452c.slice/crio-7d4a6840e187e8443fbba7aa22b3299f1160aa550c8bfe2aba09c90c5930e1fa WatchSource:0}: Error finding container 7d4a6840e187e8443fbba7aa22b3299f1160aa550c8bfe2aba09c90c5930e1fa: Status 404 returned error can't find the container with id 7d4a6840e187e8443fbba7aa22b3299f1160aa550c8bfe2aba09c90c5930e1fa Jul 08 00:18:46.939324 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:46.939246 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7887d4f798-7dmhj" event={"ID":"05f3b024-0257-49f7-9bda-122e0610452c","Type":"ContainerStarted","Data":"7d4a6840e187e8443fbba7aa22b3299f1160aa550c8bfe2aba09c90c5930e1fa"} Jul 08 00:18:46.941205 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:46.941131 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" event={"ID":"ab50a784-8c28-44b1-85d8-fff6881b35af","Type":"ContainerStarted","Data":"27b3fde0b03ab02cd4a0ddb661879050913ba470f34843d95936ad2594bf5e87"} Jul 08 00:18:48.676403 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:48.676371 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:48.793308 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:48.793273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:18:48.954498 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:48.954460 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7887d4f798-7dmhj" event={"ID":"05f3b024-0257-49f7-9bda-122e0610452c","Type":"ContainerStarted","Data":"c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89"} Jul 08 00:18:48.954702 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:48.954607 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:18:48.955886 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:48.955860 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" event={"ID":"ab50a784-8c28-44b1-85d8-fff6881b35af","Type":"ContainerStarted","Data":"fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe"} Jul 08 00:18:48.956007 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:48.955977 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:48.974934 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:48.974878 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7887d4f798-7dmhj" podStartSLOduration=1.5411583599999998 podStartE2EDuration="3.974862051s" totalImagesPullingTime="2.433703691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:18:48.972698488 +0000 UTC m=+531.451543744" watchObservedRunningTime="2026-07-08 00:18:48.974862051 +0000 UTC m=+531.453707304" Jul 08 00:18:48.990372 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:48.990307 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" podStartSLOduration=1.506815775 podStartE2EDuration="3.990293235s" totalImagesPullingTime="2.48347746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:18:48.989685711 +0000 UTC m=+531.468530986" watchObservedRunningTime="2026-07-08 00:18:48.990293235 +0000 UTC m=+531.469138489" Jul 08 00:18:59.966803 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:59.966768 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:18:59.967267 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:18:59.966878 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:19:00.027954 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.027916 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59b4bfc564-rpvc2"] Jul 08 00:19:00.028249 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.028197 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" podUID="ab50a784-8c28-44b1-85d8-fff6881b35af" containerName="manager" containerID="cri-o://fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe" gracePeriod=30 Jul 08 00:19:00.283400 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.283369 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:19:00.414808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.414766 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skljh\" (UniqueName: \"kubernetes.io/projected/ab50a784-8c28-44b1-85d8-fff6881b35af-kube-api-access-skljh\") pod \"ab50a784-8c28-44b1-85d8-fff6881b35af\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " Jul 08 00:19:00.414808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.414816 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50a784-8c28-44b1-85d8-fff6881b35af-service-ca\") pod \"ab50a784-8c28-44b1-85d8-fff6881b35af\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " Jul 08 00:19:00.415084 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.414856 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab50a784-8c28-44b1-85d8-fff6881b35af-webhook-cert\") pod \"ab50a784-8c28-44b1-85d8-fff6881b35af\" (UID: \"ab50a784-8c28-44b1-85d8-fff6881b35af\") " Jul 08 00:19:00.415257 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.415231 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab50a784-8c28-44b1-85d8-fff6881b35af-service-ca" (OuterVolumeSpecName: "service-ca") pod "ab50a784-8c28-44b1-85d8-fff6881b35af" (UID: "ab50a784-8c28-44b1-85d8-fff6881b35af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:19:00.417215 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.417190 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab50a784-8c28-44b1-85d8-fff6881b35af-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ab50a784-8c28-44b1-85d8-fff6881b35af" (UID: "ab50a784-8c28-44b1-85d8-fff6881b35af"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:19:00.417307 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.417212 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab50a784-8c28-44b1-85d8-fff6881b35af-kube-api-access-skljh" (OuterVolumeSpecName: "kube-api-access-skljh") pod "ab50a784-8c28-44b1-85d8-fff6881b35af" (UID: "ab50a784-8c28-44b1-85d8-fff6881b35af"). InnerVolumeSpecName "kube-api-access-skljh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:19:00.515877 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.515772 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skljh\" (UniqueName: \"kubernetes.io/projected/ab50a784-8c28-44b1-85d8-fff6881b35af-kube-api-access-skljh\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:19:00.515877 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.515810 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab50a784-8c28-44b1-85d8-fff6881b35af-service-ca\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:19:00.515877 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:00.515824 2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab50a784-8c28-44b1-85d8-fff6881b35af-webhook-cert\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:19:01.024982 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:01.024939 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab50a784-8c28-44b1-85d8-fff6881b35af" containerID="fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe" exitCode=0 Jul 08 00:19:01.025520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:01.024994 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" Jul 08 00:19:01.025520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:01.025028 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" event={"ID":"ab50a784-8c28-44b1-85d8-fff6881b35af","Type":"ContainerDied","Data":"fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe"} Jul 08 00:19:01.025520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:01.025085 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59b4bfc564-rpvc2" event={"ID":"ab50a784-8c28-44b1-85d8-fff6881b35af","Type":"ContainerDied","Data":"27b3fde0b03ab02cd4a0ddb661879050913ba470f34843d95936ad2594bf5e87"} Jul 08 00:19:01.025520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:01.025133 2573 scope.go:117] "RemoveContainer" containerID="fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe" Jul 08 00:19:01.034871 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:01.034660 2573 scope.go:117] "RemoveContainer" containerID="fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe" Jul 08 00:19:01.035013 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:19:01.034994 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe\": container with ID starting with fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe not found: ID does not exist" containerID="fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe" Jul 08 00:19:01.035062 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:01.035024 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe"} err="failed to get container status \"fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe\": rpc error: code = NotFound desc = could not find container \"fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe\": container with ID starting with fa9c8bf221f24a5968beaeeca1f89b52f7f2821d775b1a6c601f98b93093fdfe not found: ID does not exist" Jul 08 00:19:01.045507 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:01.045479 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59b4bfc564-rpvc2"] Jul 08 00:19:01.050392 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:01.050369 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59b4bfc564-rpvc2"] Jul 08 00:19:02.117014 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:02.116978 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab50a784-8c28-44b1-85d8-fff6881b35af" path="/var/lib/kubelet/pods/ab50a784-8c28-44b1-85d8-fff6881b35af/volumes" Jul 08 00:19:20.185912 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.185854 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:19:20.751019 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.750968 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:19:20.800989 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.800942 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-77976bf6d-77925"] Jul 08 00:19:20.801390 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.801376 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab50a784-8c28-44b1-85d8-fff6881b35af" containerName="manager" Jul 08 00:19:20.801499 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.801391 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab50a784-8c28-44b1-85d8-fff6881b35af" containerName="manager" Jul 08 00:19:20.801499 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.801455 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab50a784-8c28-44b1-85d8-fff6881b35af" containerName="manager" Jul 08 00:19:20.804912 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.804886 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:20.807763 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.807719 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pvfg8\"" Jul 08 00:19:20.807895 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.807882 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 08 00:19:20.816928 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.816891 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77976bf6d-77925"] Jul 08 00:19:20.874953 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.874906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9aba737f-7d54-429e-a57e-9674611ce2c3-maas-api-tls\") pod \"maas-api-77976bf6d-77925\" (UID: \"9aba737f-7d54-429e-a57e-9674611ce2c3\") " pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:20.875198 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.875146 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aba737f-7d54-429e-a57e-9674611ce2c3-openshift-service-ca\") pod \"maas-api-77976bf6d-77925\" (UID: \"9aba737f-7d54-429e-a57e-9674611ce2c3\") " pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:20.875198 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.875194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lmv9\" (UniqueName: \"kubernetes.io/projected/9aba737f-7d54-429e-a57e-9674611ce2c3-kube-api-access-4lmv9\") pod \"maas-api-77976bf6d-77925\" (UID: \"9aba737f-7d54-429e-a57e-9674611ce2c3\") " pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:20.913150 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.913063 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:19:20.976487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.976448 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lmv9\" (UniqueName: \"kubernetes.io/projected/9aba737f-7d54-429e-a57e-9674611ce2c3-kube-api-access-4lmv9\") pod \"maas-api-77976bf6d-77925\" (UID: \"9aba737f-7d54-429e-a57e-9674611ce2c3\") " pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:20.976663 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.976505 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9aba737f-7d54-429e-a57e-9674611ce2c3-maas-api-tls\") pod \"maas-api-77976bf6d-77925\" (UID: \"9aba737f-7d54-429e-a57e-9674611ce2c3\") " pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:20.976663 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.976593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aba737f-7d54-429e-a57e-9674611ce2c3-openshift-service-ca\") pod \"maas-api-77976bf6d-77925\" (UID: \"9aba737f-7d54-429e-a57e-9674611ce2c3\") " pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:20.977388 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.977364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9aba737f-7d54-429e-a57e-9674611ce2c3-openshift-service-ca\") pod \"maas-api-77976bf6d-77925\" (UID: \"9aba737f-7d54-429e-a57e-9674611ce2c3\") " pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:20.979456 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.979432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9aba737f-7d54-429e-a57e-9674611ce2c3-maas-api-tls\") pod \"maas-api-77976bf6d-77925\" (UID: \"9aba737f-7d54-429e-a57e-9674611ce2c3\") " pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:20.986874 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:20.986841 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lmv9\" (UniqueName: \"kubernetes.io/projected/9aba737f-7d54-429e-a57e-9674611ce2c3-kube-api-access-4lmv9\") pod \"maas-api-77976bf6d-77925\" (UID: \"9aba737f-7d54-429e-a57e-9674611ce2c3\") " pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:21.117554 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.117472 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:21.168431 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.168398 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:19:21.270289 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.270251 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-ch8q8"] Jul 08 00:19:21.272190 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.272151 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:19:21.274117 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.274075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:21.276821 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.276755 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 00:19:21.277384 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.277358 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-f669j\"" Jul 08 00:19:21.279769 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.279744 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88hc\" (UniqueName: \"kubernetes.io/projected/1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac-kube-api-access-j88hc\") pod \"payload-pre-processing-7964457696-ch8q8\" (UID: \"1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:21.279883 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.279799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac-plugins-config-volume\") pod \"payload-pre-processing-7964457696-ch8q8\" (UID: \"1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:21.289269 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.288800 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-ch8q8"] Jul 08 00:19:21.292246 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.292186 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-77976bf6d-77925"] Jul 08 00:19:21.294579 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:19:21.294552 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aba737f_7d54_429e_a57e_9674611ce2c3.slice/crio-e2ede3c50e181d14dd6c157ad74ecf5539b19fcf99ffc187fa9679eaa3cc5692 WatchSource:0}: Error finding container e2ede3c50e181d14dd6c157ad74ecf5539b19fcf99ffc187fa9679eaa3cc5692: Status 404 returned error can't find the container with id e2ede3c50e181d14dd6c157ad74ecf5539b19fcf99ffc187fa9679eaa3cc5692 Jul 08 00:19:21.381003 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.380903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac-plugins-config-volume\") pod \"payload-pre-processing-7964457696-ch8q8\" (UID: \"1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:21.381003 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.381000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j88hc\" (UniqueName: \"kubernetes.io/projected/1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac-kube-api-access-j88hc\") pod \"payload-pre-processing-7964457696-ch8q8\" (UID: \"1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:21.381701 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.381679 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac-plugins-config-volume\") pod \"payload-pre-processing-7964457696-ch8q8\" (UID: \"1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:21.391770 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.391738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j88hc\" (UniqueName: \"kubernetes.io/projected/1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac-kube-api-access-j88hc\") pod \"payload-pre-processing-7964457696-ch8q8\" (UID: \"1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:21.589203 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.589162 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:21.735745 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:21.735716 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-ch8q8"] Jul 08 00:19:21.737452 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:19:21.737422 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a31f0e6_a1c4_4b7e_abef_bab1fa1fc5ac.slice/crio-e6807bf7a6a58c9a4902d2aa9a98bd5a92c291133fd8b3d57962d6af5043a4dc WatchSource:0}: Error finding container e6807bf7a6a58c9a4902d2aa9a98bd5a92c291133fd8b3d57962d6af5043a4dc: Status 404 returned error can't find the container with id e6807bf7a6a58c9a4902d2aa9a98bd5a92c291133fd8b3d57962d6af5043a4dc Jul 08 00:19:22.154702 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:22.154658 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" event={"ID":"1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac","Type":"ContainerStarted","Data":"e6807bf7a6a58c9a4902d2aa9a98bd5a92c291133fd8b3d57962d6af5043a4dc"} Jul 08 00:19:22.156239 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:22.156205 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" event={"ID":"9aba737f-7d54-429e-a57e-9674611ce2c3","Type":"ContainerStarted","Data":"e2ede3c50e181d14dd6c157ad74ecf5539b19fcf99ffc187fa9679eaa3cc5692"} Jul 08 00:19:24.170811 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:24.170777 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" event={"ID":"9aba737f-7d54-429e-a57e-9674611ce2c3","Type":"ContainerStarted","Data":"644b349b21b6ded505123975dadf0d517295c58d602f7a116efc4cce49ecc5ba"} Jul 08 00:19:24.171364 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:24.170860 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:24.172524 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:24.172502 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" event={"ID":"1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac","Type":"ContainerStarted","Data":"ce4d8edd2a9c3534cd6177ee097e41430caff340e8650c7a36cf3595f83db0f8"} Jul 08 00:19:24.172665 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:24.172644 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:24.189359 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:24.189305 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" podStartSLOduration=1.953934625 podStartE2EDuration="4.189286006s" totalImagesPullingTime="2.235351381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:19:24.187871968 +0000 UTC m=+566.666717222" watchObservedRunningTime="2026-07-08 00:19:24.189286006 +0000 UTC m=+566.668131260" Jul 08 00:19:24.203842 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:24.203789 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" podStartSLOduration=1.413689777 podStartE2EDuration="3.203769286s" totalImagesPullingTime="1.790079509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:19:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:19:24.202980551 +0000 UTC m=+566.681825810" watchObservedRunningTime="2026-07-08 00:19:24.203769286 +0000 UTC m=+566.682614540" Jul 08 00:19:30.185349 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:30.185315 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-77976bf6d-77925" Jul 08 00:19:31.622047 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:31.622014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:19:31.721296 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:31.721255 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:19:35.181986 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:35.181955 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-ch8q8" Jul 08 00:19:39.107439 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:39.107398 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:19:41.718130 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.718076 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv"] Jul 08 00:19:41.722935 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.722914 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.725566 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.725544 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 00:19:41.726831 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.726806 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dmw25\"" Jul 08 00:19:41.726961 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.726852 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 00:19:41.726961 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.726868 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 00:19:41.730614 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.730388 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv"] Jul 08 00:19:41.749719 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.749688 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:19:41.779071 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.779029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkg8l\" (UniqueName: \"kubernetes.io/projected/cca65d17-5407-4a62-aa65-763dfed1fc32-kube-api-access-wkg8l\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.779303 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.779117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cca65d17-5407-4a62-aa65-763dfed1fc32-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.779303 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.779165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.779303 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.779198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.779303 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.779252 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.779527 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.779317 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.880463 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.880427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cca65d17-5407-4a62-aa65-763dfed1fc32-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.880671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.880480 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.880671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.880517 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.880671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.880556 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.880671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.880602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.880671 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.880651 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkg8l\" (UniqueName: \"kubernetes.io/projected/cca65d17-5407-4a62-aa65-763dfed1fc32-kube-api-access-wkg8l\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.880972 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.880944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.881176 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.881005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.881176 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.881046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.883036 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.883008 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cca65d17-5407-4a62-aa65-763dfed1fc32-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.883214 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.883196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cca65d17-5407-4a62-aa65-763dfed1fc32-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:41.889270 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:41.889225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkg8l\" (UniqueName: \"kubernetes.io/projected/cca65d17-5407-4a62-aa65-763dfed1fc32-kube-api-access-wkg8l\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nhtwv\" (UID: \"cca65d17-5407-4a62-aa65-763dfed1fc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:42.034808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:42.034711 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:42.185677 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:42.185642 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv"] Jul 08 00:19:42.187028 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:19:42.187000 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca65d17_5407_4a62_aa65_763dfed1fc32.slice/crio-4038cced57dc3cd335b11a5105ace4db3d7113fbe56a2219a4fb8947dd888124 WatchSource:0}: Error finding container 4038cced57dc3cd335b11a5105ace4db3d7113fbe56a2219a4fb8947dd888124: Status 404 returned error can't find the container with id 4038cced57dc3cd335b11a5105ace4db3d7113fbe56a2219a4fb8947dd888124 Jul 08 00:19:42.285866 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:42.285824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" event={"ID":"cca65d17-5407-4a62-aa65-763dfed1fc32","Type":"ContainerStarted","Data":"4038cced57dc3cd335b11a5105ace4db3d7113fbe56a2219a4fb8947dd888124"} Jul 08 00:19:44.300623 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:44.300588 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" event={"ID":"cca65d17-5407-4a62-aa65-763dfed1fc32","Type":"ContainerStarted","Data":"a7121343159f41f290ff63f95aa17147e588c3f6ee189bf5af94e674daea9459"} Jul 08 00:19:44.322410 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:44.322335 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" podStartSLOduration=2.275903998 podStartE2EDuration="3.322306907s" totalImagesPullingTime="1.046402909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:19:44.317058123 +0000 UTC m=+586.795903379" watchObservedRunningTime="2026-07-08 00:19:44.322306907 +0000 UTC m=+586.801152164" Jul 08 00:19:52.035444 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:52.035394 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:52.035978 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:52.035502 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:52.048448 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:52.048419 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:52.358245 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:52.358215 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nhtwv" Jul 08 00:19:58.840607 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:19:58.840575 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:20:04.415960 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.415922 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7"] Jul 08 00:20:04.419593 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.419574 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.422373 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.422349 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 00:20:04.428561 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.428534 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7"] Jul 08 00:20:04.490293 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.490253 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg5rv\" (UniqueName: \"kubernetes.io/projected/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-kube-api-access-mg5rv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.490486 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.490330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.490486 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.490368 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.490486 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.490417 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.490486 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.490470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.490629 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.490496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.591479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.591430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.591479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.591480 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.591761 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.591509 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg5rv\" (UniqueName: \"kubernetes.io/projected/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-kube-api-access-mg5rv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.591761 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.591559 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.591761 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.591590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.591761 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.591644 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.591958 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.591887 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.592002 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.591985 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.592040 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.592007 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.593982 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.593951 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.594307 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.594287 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.599866 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.599833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg5rv\" (UniqueName: \"kubernetes.io/projected/c8d994c5-a5ff-4ec6-92a9-44feac8488fb-kube-api-access-mg5rv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7\" (UID: \"c8d994c5-a5ff-4ec6-92a9-44feac8488fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.730537 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.730436 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:04.878871 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:04.878828 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7"] Jul 08 00:20:04.880013 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:20:04.879981 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d994c5_a5ff_4ec6_92a9_44feac8488fb.slice/crio-5ee58c2071c2bea2c896727edc5e80a9107f429e22796940ae118f6b51b0767e WatchSource:0}: Error finding container 5ee58c2071c2bea2c896727edc5e80a9107f429e22796940ae118f6b51b0767e: Status 404 returned error can't find the container with id 5ee58c2071c2bea2c896727edc5e80a9107f429e22796940ae118f6b51b0767e Jul 08 00:20:05.425057 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:05.424957 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" event={"ID":"c8d994c5-a5ff-4ec6-92a9-44feac8488fb","Type":"ContainerStarted","Data":"bf03b6b36f167e803113d33cf414dee291a059a61f5d706f4def84a1e032a5f0"} Jul 08 00:20:05.425057 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:05.425015 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" event={"ID":"c8d994c5-a5ff-4ec6-92a9-44feac8488fb","Type":"ContainerStarted","Data":"5ee58c2071c2bea2c896727edc5e80a9107f429e22796940ae118f6b51b0767e"} Jul 08 00:20:05.442298 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:05.442238 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" podStartSLOduration=1.25054388 podStartE2EDuration="1.442221649s" totalImagesPullingTime="191.677769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:20:05.441970677 +0000 UTC m=+607.920815946" watchObservedRunningTime="2026-07-08 00:20:05.442221649 +0000 UTC m=+607.921066899" Jul 08 00:20:07.838658 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:07.838622 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:20:14.731639 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:14.731598 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:14.732027 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:14.731680 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:14.744491 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:14.744452 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:15.496420 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:15.496388 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7" Jul 08 00:20:16.520656 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:16.520617 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:20:18.818932 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:18.818892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:20:18.879679 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:18.879635 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:20:52.761923 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:52.761880 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:20:52.816149 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:52.816113 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:20:55.234789 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:20:55.234749 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:21:19.828973 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:19.828934 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:21:46.649627 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:46.649582 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:21:46.759542 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:46.759495 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:21:47.772542 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:47.772506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:21:47.863487 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:47.863450 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:21:47.892139 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:47.892079 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76ff99fbcf-bgrcn"] Jul 08 00:21:47.892370 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:47.892315 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" podUID="1fe959e4-3bda-420f-ba6d-c215a20e18f1" containerName="authorino" containerID="cri-o://7d6ff5709ad046ce97cc1b6475cc1232249d6da4a1d134aaa1f7f70187fbf0b2" gracePeriod=30 Jul 08 00:21:48.037157 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:48.037130 2573 generic.go:356] "Generic (PLEG): container finished" podID="1fe959e4-3bda-420f-ba6d-c215a20e18f1" containerID="7d6ff5709ad046ce97cc1b6475cc1232249d6da4a1d134aaa1f7f70187fbf0b2" exitCode=0 Jul 08 00:21:48.037320 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:48.037172 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" event={"ID":"1fe959e4-3bda-420f-ba6d-c215a20e18f1","Type":"ContainerDied","Data":"7d6ff5709ad046ce97cc1b6475cc1232249d6da4a1d134aaa1f7f70187fbf0b2"} Jul 08 00:21:48.153868 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:48.153841 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:21:48.333189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:48.333066 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fe959e4-3bda-420f-ba6d-c215a20e18f1-tls-cert\") pod \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\" (UID: \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\") " Jul 08 00:21:48.333189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:48.333147 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drhpk\" (UniqueName: \"kubernetes.io/projected/1fe959e4-3bda-420f-ba6d-c215a20e18f1-kube-api-access-drhpk\") pod \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\" (UID: \"1fe959e4-3bda-420f-ba6d-c215a20e18f1\") " Jul 08 00:21:48.335249 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:48.335213 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fe959e4-3bda-420f-ba6d-c215a20e18f1-kube-api-access-drhpk" (OuterVolumeSpecName: "kube-api-access-drhpk") pod "1fe959e4-3bda-420f-ba6d-c215a20e18f1" (UID: "1fe959e4-3bda-420f-ba6d-c215a20e18f1"). InnerVolumeSpecName "kube-api-access-drhpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:21:48.345897 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:48.345866 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fe959e4-3bda-420f-ba6d-c215a20e18f1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1fe959e4-3bda-420f-ba6d-c215a20e18f1" (UID: "1fe959e4-3bda-420f-ba6d-c215a20e18f1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:21:48.433869 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:48.433838 2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1fe959e4-3bda-420f-ba6d-c215a20e18f1-tls-cert\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:21:48.433869 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:48.433867 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drhpk\" (UniqueName: \"kubernetes.io/projected/1fe959e4-3bda-420f-ba6d-c215a20e18f1-kube-api-access-drhpk\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:21:49.043918 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:49.043885 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" Jul 08 00:21:49.044426 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:49.043935 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76ff99fbcf-bgrcn" event={"ID":"1fe959e4-3bda-420f-ba6d-c215a20e18f1","Type":"ContainerDied","Data":"fd1f252186fa085a61ce1ee726460ec52acfab1ff4d1c55b3568051984834f62"} Jul 08 00:21:49.044426 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:49.044001 2573 scope.go:117] "RemoveContainer" containerID="7d6ff5709ad046ce97cc1b6475cc1232249d6da4a1d134aaa1f7f70187fbf0b2" Jul 08 00:21:49.069461 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:49.069419 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76ff99fbcf-bgrcn"] Jul 08 00:21:49.073146 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:49.073110 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76ff99fbcf-bgrcn"] Jul 08 00:21:50.117370 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:21:50.117332 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fe959e4-3bda-420f-ba6d-c215a20e18f1" path="/var/lib/kubelet/pods/1fe959e4-3bda-420f-ba6d-c215a20e18f1/volumes" Jul 08 00:22:29.305753 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:22:29.305711 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:22:31.401157 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:22:31.401116 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:22:31.502161 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:22:31.502129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:23:54.662981 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:54.662940 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:23:58.708614 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:58.708582 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:23:58.808347 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:58.808308 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7887d4f798-7dmhj"] Jul 08 00:23:58.808599 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:58.808555 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7887d4f798-7dmhj" podUID="05f3b024-0257-49f7-9bda-122e0610452c" containerName="manager" containerID="cri-o://c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89" gracePeriod=30 Jul 08 00:23:59.064590 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.064561 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:23:59.134657 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.134622 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dm7b\" (UniqueName: \"kubernetes.io/projected/05f3b024-0257-49f7-9bda-122e0610452c-kube-api-access-7dm7b\") pod \"05f3b024-0257-49f7-9bda-122e0610452c\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " Jul 08 00:23:59.134846 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.134694 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05f3b024-0257-49f7-9bda-122e0610452c-webhook-cert\") pod \"05f3b024-0257-49f7-9bda-122e0610452c\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " Jul 08 00:23:59.134846 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.134739 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05f3b024-0257-49f7-9bda-122e0610452c-service-ca\") pod \"05f3b024-0257-49f7-9bda-122e0610452c\" (UID: \"05f3b024-0257-49f7-9bda-122e0610452c\") " Jul 08 00:23:59.135141 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.135115 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f3b024-0257-49f7-9bda-122e0610452c-service-ca" (OuterVolumeSpecName: "service-ca") pod "05f3b024-0257-49f7-9bda-122e0610452c" (UID: "05f3b024-0257-49f7-9bda-122e0610452c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 00:23:59.136865 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.136833 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05f3b024-0257-49f7-9bda-122e0610452c-kube-api-access-7dm7b" (OuterVolumeSpecName: "kube-api-access-7dm7b") pod "05f3b024-0257-49f7-9bda-122e0610452c" (UID: "05f3b024-0257-49f7-9bda-122e0610452c"). InnerVolumeSpecName "kube-api-access-7dm7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:23:59.137045 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.137018 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05f3b024-0257-49f7-9bda-122e0610452c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "05f3b024-0257-49f7-9bda-122e0610452c" (UID: "05f3b024-0257-49f7-9bda-122e0610452c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 00:23:59.236531 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.236428 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dm7b\" (UniqueName: \"kubernetes.io/projected/05f3b024-0257-49f7-9bda-122e0610452c-kube-api-access-7dm7b\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:23:59.236531 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.236468 2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05f3b024-0257-49f7-9bda-122e0610452c-webhook-cert\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:23:59.236531 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.236477 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05f3b024-0257-49f7-9bda-122e0610452c-service-ca\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:23:59.816759 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.816723 2573 generic.go:356] "Generic (PLEG): container finished" podID="05f3b024-0257-49f7-9bda-122e0610452c" containerID="c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89" exitCode=0 Jul 08 00:23:59.817289 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.816773 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7887d4f798-7dmhj" Jul 08 00:23:59.817289 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.816810 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7887d4f798-7dmhj" event={"ID":"05f3b024-0257-49f7-9bda-122e0610452c","Type":"ContainerDied","Data":"c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89"} Jul 08 00:23:59.817289 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.816868 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7887d4f798-7dmhj" event={"ID":"05f3b024-0257-49f7-9bda-122e0610452c","Type":"ContainerDied","Data":"7d4a6840e187e8443fbba7aa22b3299f1160aa550c8bfe2aba09c90c5930e1fa"} Jul 08 00:23:59.817289 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.816898 2573 scope.go:117] "RemoveContainer" containerID="c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89" Jul 08 00:23:59.827026 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.827007 2573 scope.go:117] "RemoveContainer" containerID="c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89" Jul 08 00:23:59.827329 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:23:59.827304 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89\": container with ID starting with c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89 not found: ID does not exist" containerID="c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89" Jul 08 00:23:59.827426 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.827335 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89"} err="failed to get container status \"c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89\": rpc error: code = NotFound desc = could not find container \"c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89\": container with ID starting with c713f0e552218fe4a7aa0f11bcbbd09d73147bf051075a978fde4e7c78afee89 not found: ID does not exist" Jul 08 00:23:59.839170 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.839138 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7887d4f798-7dmhj"] Jul 08 00:23:59.842802 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:23:59.842772 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7887d4f798-7dmhj"] Jul 08 00:24:00.116589 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.116501 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05f3b024-0257-49f7-9bda-122e0610452c" path="/var/lib/kubelet/pods/05f3b024-0257-49f7-9bda-122e0610452c/volumes" Jul 08 00:24:00.481314 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.481224 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:24:00.607533 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.607491 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7887d4f798-trmvw"] Jul 08 00:24:00.607926 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.607912 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f3b024-0257-49f7-9bda-122e0610452c" containerName="manager" Jul 08 00:24:00.607973 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.607928 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f3b024-0257-49f7-9bda-122e0610452c" containerName="manager" Jul 08 00:24:00.607973 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.607939 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fe959e4-3bda-420f-ba6d-c215a20e18f1" containerName="authorino" Jul 08 00:24:00.607973 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.607944 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fe959e4-3bda-420f-ba6d-c215a20e18f1" containerName="authorino" Jul 08 00:24:00.608072 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.608021 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fe959e4-3bda-420f-ba6d-c215a20e18f1" containerName="authorino" Jul 08 00:24:00.608072 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.608029 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f3b024-0257-49f7-9bda-122e0610452c" containerName="manager" Jul 08 00:24:00.612793 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.612773 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.617157 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.617130 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 00:24:00.617157 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.617154 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 00:24:00.617380 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.617130 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g2vlt\"" Jul 08 00:24:00.623145 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.623112 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7887d4f798-trmvw"] Jul 08 00:24:00.750189 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.750040 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qv7z\" (UniqueName: \"kubernetes.io/projected/22589ad7-a32e-4512-a5b8-53ab93b87cdc-kube-api-access-4qv7z\") pod \"maas-controller-7887d4f798-trmvw\" (UID: \"22589ad7-a32e-4512-a5b8-53ab93b87cdc\") " pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.750366 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.750215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22589ad7-a32e-4512-a5b8-53ab93b87cdc-webhook-cert\") pod \"maas-controller-7887d4f798-trmvw\" (UID: \"22589ad7-a32e-4512-a5b8-53ab93b87cdc\") " pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.750366 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.750281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22589ad7-a32e-4512-a5b8-53ab93b87cdc-service-ca\") pod \"maas-controller-7887d4f798-trmvw\" (UID: \"22589ad7-a32e-4512-a5b8-53ab93b87cdc\") " pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.851520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.851479 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22589ad7-a32e-4512-a5b8-53ab93b87cdc-webhook-cert\") pod \"maas-controller-7887d4f798-trmvw\" (UID: \"22589ad7-a32e-4512-a5b8-53ab93b87cdc\") " pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.851935 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.851550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22589ad7-a32e-4512-a5b8-53ab93b87cdc-service-ca\") pod \"maas-controller-7887d4f798-trmvw\" (UID: \"22589ad7-a32e-4512-a5b8-53ab93b87cdc\") " pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.851935 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.851610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qv7z\" (UniqueName: \"kubernetes.io/projected/22589ad7-a32e-4512-a5b8-53ab93b87cdc-kube-api-access-4qv7z\") pod \"maas-controller-7887d4f798-trmvw\" (UID: \"22589ad7-a32e-4512-a5b8-53ab93b87cdc\") " pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.852287 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.852268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22589ad7-a32e-4512-a5b8-53ab93b87cdc-service-ca\") pod \"maas-controller-7887d4f798-trmvw\" (UID: \"22589ad7-a32e-4512-a5b8-53ab93b87cdc\") " pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.854060 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.854036 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22589ad7-a32e-4512-a5b8-53ab93b87cdc-webhook-cert\") pod \"maas-controller-7887d4f798-trmvw\" (UID: \"22589ad7-a32e-4512-a5b8-53ab93b87cdc\") " pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.861803 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.861755 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qv7z\" (UniqueName: \"kubernetes.io/projected/22589ad7-a32e-4512-a5b8-53ab93b87cdc-kube-api-access-4qv7z\") pod \"maas-controller-7887d4f798-trmvw\" (UID: \"22589ad7-a32e-4512-a5b8-53ab93b87cdc\") " pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:00.924369 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:00.924329 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:01.064724 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:01.064697 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7887d4f798-trmvw"] Jul 08 00:24:01.066713 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:24:01.066680 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22589ad7_a32e_4512_a5b8_53ab93b87cdc.slice/crio-df0c884c3031209ae424c0c9f9ea96258fc9af2c189616bc203f94182810e901 WatchSource:0}: Error finding container df0c884c3031209ae424c0c9f9ea96258fc9af2c189616bc203f94182810e901: Status 404 returned error can't find the container with id df0c884c3031209ae424c0c9f9ea96258fc9af2c189616bc203f94182810e901 Jul 08 00:24:01.068227 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:01.068204 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 00:24:01.830606 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:01.830569 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7887d4f798-trmvw" event={"ID":"22589ad7-a32e-4512-a5b8-53ab93b87cdc","Type":"ContainerStarted","Data":"a1a98a8a3a3a2953854ca4a7b8700b14c9d54c0cbbaa6bcd58239e115a011371"} Jul 08 00:24:01.830787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:01.830624 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7887d4f798-trmvw" event={"ID":"22589ad7-a32e-4512-a5b8-53ab93b87cdc","Type":"ContainerStarted","Data":"df0c884c3031209ae424c0c9f9ea96258fc9af2c189616bc203f94182810e901"} Jul 08 00:24:01.830787 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:01.830658 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:24:01.848317 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:01.848211 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7887d4f798-trmvw" podStartSLOduration=1.3233934139999999 podStartE2EDuration="1.848194772s" totalImagesPullingTime="524.801358ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:24:01.846515653 +0000 UTC m=+844.325360926" watchObservedRunningTime="2026-07-08 00:24:01.848194772 +0000 UTC m=+844.327040085" Jul 08 00:24:07.246828 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:07.246793 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:24:07.299695 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:07.299659 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:24:12.842262 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:24:12.842230 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7887d4f798-trmvw" Jul 08 00:27:08.163159 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:27:08.163116 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:27:09.485720 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:27:09.485683 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:27:14.035167 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:27:14.035120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:27:14.144563 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:27:14.144526 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:27:14.240156 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:27:14.240120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:27:14.388028 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:27:14.387992 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:27:19.926879 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:27:19.926842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:27:19.987124 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:27:19.987054 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:28:06.390433 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:28:06.390355 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:30:00.142968 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.142929 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb"] Jul 08 00:30:00.146367 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.146347 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" Jul 08 00:30:00.160810 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.160774 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb"] Jul 08 00:30:00.247690 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.247648 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fvlk\" (UniqueName: \"kubernetes.io/projected/1a9a45ee-38d5-40b0-bdc7-4620249aa863-kube-api-access-7fvlk\") pod \"maas-api-key-cleanup-29724510-g9jtb\" (UID: \"1a9a45ee-38d5-40b0-bdc7-4620249aa863\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" Jul 08 00:30:00.348790 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.348743 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fvlk\" (UniqueName: \"kubernetes.io/projected/1a9a45ee-38d5-40b0-bdc7-4620249aa863-kube-api-access-7fvlk\") pod \"maas-api-key-cleanup-29724510-g9jtb\" (UID: \"1a9a45ee-38d5-40b0-bdc7-4620249aa863\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" Jul 08 00:30:00.357886 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.357860 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fvlk\" (UniqueName: \"kubernetes.io/projected/1a9a45ee-38d5-40b0-bdc7-4620249aa863-kube-api-access-7fvlk\") pod \"maas-api-key-cleanup-29724510-g9jtb\" (UID: \"1a9a45ee-38d5-40b0-bdc7-4620249aa863\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" Jul 08 00:30:00.456808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.456726 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" Jul 08 00:30:00.598778 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.598749 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb"] Jul 08 00:30:00.600632 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:30:00.600597 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9a45ee_38d5_40b0_bdc7_4620249aa863.slice/crio-4854a38cf996a6dbadc2597cde89d8dd0427aeba33d4decaab0f164f03dba474 WatchSource:0}: Error finding container 4854a38cf996a6dbadc2597cde89d8dd0427aeba33d4decaab0f164f03dba474: Status 404 returned error can't find the container with id 4854a38cf996a6dbadc2597cde89d8dd0427aeba33d4decaab0f164f03dba474 Jul 08 00:30:00.602568 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.602553 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 00:30:00.873150 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:00.873118 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" event={"ID":"1a9a45ee-38d5-40b0-bdc7-4620249aa863","Type":"ContainerStarted","Data":"4854a38cf996a6dbadc2597cde89d8dd0427aeba33d4decaab0f164f03dba474"} Jul 08 00:30:04.896296 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:04.896263 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" event={"ID":"1a9a45ee-38d5-40b0-bdc7-4620249aa863","Type":"ContainerStarted","Data":"fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879"} Jul 08 00:30:04.914040 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:30:04.913986 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" podStartSLOduration=1.60944313 podStartE2EDuration="4.913969245s" totalImagesPullingTime="3.304526115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:30:04.91055822 +0000 UTC m=+1207.389403474" watchObservedRunningTime="2026-07-08 00:30:04.913969245 +0000 UTC m=+1207.392814498" Jul 08 00:31:00.011326 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:00.011239 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb"] Jul 08 00:31:00.012023 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:00.011437 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" podUID="1a9a45ee-38d5-40b0-bdc7-4620249aa863" containerName="cleanup" containerID="cri-o://fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879" gracePeriod=30 Jul 08 00:31:30.204126 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.204074 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" Jul 08 00:31:30.368371 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.368330 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fvlk\" (UniqueName: \"kubernetes.io/projected/1a9a45ee-38d5-40b0-bdc7-4620249aa863-kube-api-access-7fvlk\") pod \"1a9a45ee-38d5-40b0-bdc7-4620249aa863\" (UID: \"1a9a45ee-38d5-40b0-bdc7-4620249aa863\") " Jul 08 00:31:30.370464 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.370434 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a9a45ee-38d5-40b0-bdc7-4620249aa863-kube-api-access-7fvlk" (OuterVolumeSpecName: "kube-api-access-7fvlk") pod "1a9a45ee-38d5-40b0-bdc7-4620249aa863" (UID: "1a9a45ee-38d5-40b0-bdc7-4620249aa863"). InnerVolumeSpecName "kube-api-access-7fvlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 00:31:30.386833 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.386802 2573 generic.go:356] "Generic (PLEG): container finished" podID="1a9a45ee-38d5-40b0-bdc7-4620249aa863" containerID="fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879" exitCode=137 Jul 08 00:31:30.386965 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.386853 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" Jul 08 00:31:30.386965 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.386866 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" event={"ID":"1a9a45ee-38d5-40b0-bdc7-4620249aa863","Type":"ContainerDied","Data":"fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879"} Jul 08 00:31:30.386965 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.386920 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb" event={"ID":"1a9a45ee-38d5-40b0-bdc7-4620249aa863","Type":"ContainerDied","Data":"4854a38cf996a6dbadc2597cde89d8dd0427aeba33d4decaab0f164f03dba474"} Jul 08 00:31:30.386965 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.386950 2573 scope.go:117] "RemoveContainer" containerID="fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879" Jul 08 00:31:30.398781 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.398760 2573 scope.go:117] "RemoveContainer" containerID="fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879" Jul 08 00:31:30.399333 ip-10-0-128-26 kubenswrapper[2573]: E0708 00:31:30.399305 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879\": container with ID starting with fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879 not found: ID does not exist" containerID="fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879" Jul 08 00:31:30.399437 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.399344 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879"} err="failed to get container status \"fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879\": rpc error: code = NotFound desc = could not find container \"fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879\": container with ID starting with fddc8dab6f406855d743e37fe2387cda985219d04e069f4d0467dbe30e2f4879 not found: ID does not exist" Jul 08 00:31:30.412900 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.412875 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb"] Jul 08 00:31:30.416508 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.416477 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29724510-g9jtb"] Jul 08 00:31:30.469346 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:30.469314 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fvlk\" (UniqueName: \"kubernetes.io/projected/1a9a45ee-38d5-40b0-bdc7-4620249aa863-kube-api-access-7fvlk\") on node \"ip-10-0-128-26.ec2.internal\" DevicePath \"\"" Jul 08 00:31:32.116520 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:32.116489 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a9a45ee-38d5-40b0-bdc7-4620249aa863" path="/var/lib/kubelet/pods/1a9a45ee-38d5-40b0-bdc7-4620249aa863/volumes" Jul 08 00:31:57.606048 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:31:57.606010 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:32:50.178503 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:50.178467 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tgvq6_cef62655-35a5-4b8e-b3b8-8f89aabf7a59/manager/0.log" Jul 08 00:32:50.293414 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:50.293382 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2mf8n_1c60a578-c233-444e-8bda-80bf5d7dced2/manager/0.log" Jul 08 00:32:50.413360 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:50.413329 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7887d4f798-trmvw_22589ad7-a32e-4512-a5b8-53ab93b87cdc/manager/0.log" Jul 08 00:32:51.004403 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:51.004370 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bdcc84df-vj47g_197f9eeb-bb24-463b-8dfe-5425866fe41c/copy-manifests/0.log" Jul 08 00:32:51.016779 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:51.016750 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bdcc84df-vj47g_197f9eeb-bb24-463b-8dfe-5425866fe41c/manager/0.log" Jul 08 00:32:51.817182 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:51.817150 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8_7e17cef1-a2b8-452e-89f7-eba77530153a/util/0.log" Jul 08 00:32:51.823999 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:51.823972 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8_7e17cef1-a2b8-452e-89f7-eba77530153a/pull/0.log" Jul 08 00:32:51.830299 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:51.830277 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8_7e17cef1-a2b8-452e-89f7-eba77530153a/extract/0.log" Jul 08 00:32:51.942653 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:51.942624 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm_606179cc-c250-4f9e-a8dc-9a2f9ae61272/util/0.log" Jul 08 00:32:51.951925 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:51.951897 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm_606179cc-c250-4f9e-a8dc-9a2f9ae61272/pull/0.log" Jul 08 00:32:51.960035 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:51.959994 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm_606179cc-c250-4f9e-a8dc-9a2f9ae61272/extract/0.log" Jul 08 00:32:52.071236 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.071155 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8_d7bcf882-4f93-4204-837c-5f75c8a43ccd/util/0.log" Jul 08 00:32:52.078660 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.078633 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8_d7bcf882-4f93-4204-837c-5f75c8a43ccd/pull/0.log" Jul 08 00:32:52.085524 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.085498 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8_d7bcf882-4f93-4204-837c-5f75c8a43ccd/extract/0.log" Jul 08 00:32:52.193057 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.193029 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8_d8b9e78a-c408-4089-bed2-5806afdb3784/util/0.log" Jul 08 00:32:52.199974 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.199954 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8_d8b9e78a-c408-4089-bed2-5806afdb3784/pull/0.log" Jul 08 00:32:52.210662 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.210640 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8_d8b9e78a-c408-4089-bed2-5806afdb3784/extract/0.log" Jul 08 00:32:52.453765 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.453681 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dkssf_5f684df8-cff8-4360-9726-bde0f5fdb774/manager/0.log" Jul 08 00:32:52.562250 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.562218 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lv27t_7193f0de-d80e-4198-9e6e-622a3336f06f/manager/0.log" Jul 08 00:32:52.678466 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.678435 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nwgll_fd4d2aee-9a36-445d-a684-371d175fd3ef/kuadrant-console-plugin/0.log" Jul 08 00:32:52.803071 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.803039 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xkwsl_55543e66-2223-4105-91ad-bb5acd67b59a/registry-server/0.log" Jul 08 00:32:52.936768 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:52.936731 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lk7rf_4c4cd3eb-27f0-4611-bc17-951d923aa085/manager/0.log" Jul 08 00:32:53.198817 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:53.198729 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-27b9r_c0dca58c-925d-4daa-8453-ba9a6b195d25/manager/0.log" Jul 08 00:32:53.872408 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:53.872383 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56857954bd-bmnwm_dc53a85c-3a1b-4f2d-bda0-48bda127ab8d/kube-auth-proxy/0.log" Jul 08 00:32:54.115356 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:54.115318 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ch8q8_1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac/payload-pre-processing/0.log" Jul 08 00:32:54.785726 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:54.785690 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-nhtwv_cca65d17-5407-4a62-aa65-763dfed1fc32/main/0.log" Jul 08 00:32:55.014810 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:55.014776 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5hl7_c8d994c5-a5ff-4ec6-92a9-44feac8488fb/main/0.log" Jul 08 00:32:59.406488 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.406444 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jn5g/must-gather-7k6kg"] Jul 08 00:32:59.407063 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.407042 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a9a45ee-38d5-40b0-bdc7-4620249aa863" containerName="cleanup" Jul 08 00:32:59.407188 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.407067 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a9a45ee-38d5-40b0-bdc7-4620249aa863" containerName="cleanup" Jul 08 00:32:59.407255 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.407226 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a9a45ee-38d5-40b0-bdc7-4620249aa863" containerName="cleanup" Jul 08 00:32:59.410334 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.410315 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jn5g/must-gather-7k6kg" Jul 08 00:32:59.412499 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.412472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:32:59.413072 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.413049 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6jn5g\"/\"default-dockercfg-bbs2w\"" Jul 08 00:32:59.413200 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.413067 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jn5g\"/\"openshift-service-ca.crt\"" Jul 08 00:32:59.414884 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.414475 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jn5g\"/\"kube-root-ca.crt\"" Jul 08 00:32:59.417808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.417780 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jn5g/must-gather-7k6kg"] Jul 08 00:32:59.462828 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.462785 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92eb151c-5103-453a-8e26-9aa9d3eae0bd-must-gather-output\") pod \"must-gather-7k6kg\" (UID: \"92eb151c-5103-453a-8e26-9aa9d3eae0bd\") " pod="openshift-must-gather-6jn5g/must-gather-7k6kg" Jul 08 00:32:59.463012 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.462909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v96w2\" (UniqueName: \"kubernetes.io/projected/92eb151c-5103-453a-8e26-9aa9d3eae0bd-kube-api-access-v96w2\") pod \"must-gather-7k6kg\" (UID: \"92eb151c-5103-453a-8e26-9aa9d3eae0bd\") " pod="openshift-must-gather-6jn5g/must-gather-7k6kg" Jul 08 00:32:59.564275 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.564237 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92eb151c-5103-453a-8e26-9aa9d3eae0bd-must-gather-output\") pod \"must-gather-7k6kg\" (UID: \"92eb151c-5103-453a-8e26-9aa9d3eae0bd\") " pod="openshift-must-gather-6jn5g/must-gather-7k6kg" Jul 08 00:32:59.564473 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.564333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v96w2\" (UniqueName: \"kubernetes.io/projected/92eb151c-5103-453a-8e26-9aa9d3eae0bd-kube-api-access-v96w2\") pod \"must-gather-7k6kg\" (UID: \"92eb151c-5103-453a-8e26-9aa9d3eae0bd\") " pod="openshift-must-gather-6jn5g/must-gather-7k6kg" Jul 08 00:32:59.564650 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.564619 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/92eb151c-5103-453a-8e26-9aa9d3eae0bd-must-gather-output\") pod \"must-gather-7k6kg\" (UID: \"92eb151c-5103-453a-8e26-9aa9d3eae0bd\") " pod="openshift-must-gather-6jn5g/must-gather-7k6kg" Jul 08 00:32:59.572262 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.572231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v96w2\" (UniqueName: \"kubernetes.io/projected/92eb151c-5103-453a-8e26-9aa9d3eae0bd-kube-api-access-v96w2\") pod \"must-gather-7k6kg\" (UID: \"92eb151c-5103-453a-8e26-9aa9d3eae0bd\") " pod="openshift-must-gather-6jn5g/must-gather-7k6kg" Jul 08 00:32:59.721345 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.721255 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jn5g/must-gather-7k6kg" Jul 08 00:32:59.856254 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.856226 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jn5g/must-gather-7k6kg"] Jul 08 00:32:59.857433 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:32:59.857407 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92eb151c_5103_453a_8e26_9aa9d3eae0bd.slice/crio-035750dd73c62e5083229536d21084fff690b8b4a2acde7a006a59f09b84fc1c WatchSource:0}: Error finding container 035750dd73c62e5083229536d21084fff690b8b4a2acde7a006a59f09b84fc1c: Status 404 returned error can't find the container with id 035750dd73c62e5083229536d21084fff690b8b4a2acde7a006a59f09b84fc1c Jul 08 00:32:59.892669 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:32:59.892638 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jn5g/must-gather-7k6kg" event={"ID":"92eb151c-5103-453a-8e26-9aa9d3eae0bd","Type":"ContainerStarted","Data":"035750dd73c62e5083229536d21084fff690b8b4a2acde7a006a59f09b84fc1c"} Jul 08 00:33:01.292609 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:01.292565 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" limit=1024 Jul 08 00:33:01.912592 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:01.912543 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jn5g/must-gather-7k6kg" event={"ID":"92eb151c-5103-453a-8e26-9aa9d3eae0bd","Type":"ContainerStarted","Data":"65e315ebcbcd9473be9c443807a06741f97a8bb767e88a1242d22cc7fde37222"} Jul 08 00:33:01.912808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:01.912609 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jn5g/must-gather-7k6kg" event={"ID":"92eb151c-5103-453a-8e26-9aa9d3eae0bd","Type":"ContainerStarted","Data":"8befa432ea18b311bf2e7e60ab707f5a187faeef6aa21f9475b83a6b52336b47"} Jul 08 00:33:01.931823 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:01.931759 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6jn5g/must-gather-7k6kg" podStartSLOduration=1.779457871 podStartE2EDuration="2.931735802s" totalImagesPullingTime="1.152277931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 00:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:33:01.928930526 +0000 UTC m=+1384.407775781" watchObservedRunningTime="2026-07-08 00:33:01.931735802 +0000 UTC m=+1384.410581057" Jul 08 00:33:02.551172 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:02.551143 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gxr69_e922c6d7-2a40-42a4-9940-6e18dcf34f88/global-pull-secret-syncer/0.log" Jul 08 00:33:02.670743 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:02.670706 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5lqlk_f7c967a8-ef14-4b67-9bef-180b8e5a51bd/konnectivity-agent/0.log" Jul 08 00:33:02.747443 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:02.747403 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-26.ec2.internal_cae3497b7c0be2b9978bb06dee01133d/haproxy/0.log" Jul 08 00:33:06.643811 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.643781 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8_7e17cef1-a2b8-452e-89f7-eba77530153a/extract/0.log" Jul 08 00:33:06.668771 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.668738 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8_7e17cef1-a2b8-452e-89f7-eba77530153a/util/0.log" Jul 08 00:33:06.693786 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.693734 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75958td8_7e17cef1-a2b8-452e-89f7-eba77530153a/pull/0.log" Jul 08 00:33:06.722559 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.722526 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm_606179cc-c250-4f9e-a8dc-9a2f9ae61272/extract/0.log" Jul 08 00:33:06.742730 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.742701 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm_606179cc-c250-4f9e-a8dc-9a2f9ae61272/util/0.log" Jul 08 00:33:06.765978 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.765949 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nmtvm_606179cc-c250-4f9e-a8dc-9a2f9ae61272/pull/0.log" Jul 08 00:33:06.796022 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.795972 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8_d7bcf882-4f93-4204-837c-5f75c8a43ccd/extract/0.log" Jul 08 00:33:06.816052 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.815996 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8_d7bcf882-4f93-4204-837c-5f75c8a43ccd/util/0.log" Jul 08 00:33:06.837292 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.837244 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737hgk8_d7bcf882-4f93-4204-837c-5f75c8a43ccd/pull/0.log" Jul 08 00:33:06.862635 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.862607 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8_d8b9e78a-c408-4089-bed2-5806afdb3784/extract/0.log" Jul 08 00:33:06.891131 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.891038 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8_d8b9e78a-c408-4089-bed2-5806afdb3784/util/0.log" Jul 08 00:33:06.914216 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:06.914128 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ct2t8_d8b9e78a-c408-4089-bed2-5806afdb3784/pull/0.log" Jul 08 00:33:07.050696 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:07.050611 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dkssf_5f684df8-cff8-4360-9726-bde0f5fdb774/manager/0.log" Jul 08 00:33:07.100717 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:07.100668 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lv27t_7193f0de-d80e-4198-9e6e-622a3336f06f/manager/0.log" Jul 08 00:33:07.128268 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:07.128235 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nwgll_fd4d2aee-9a36-445d-a684-371d175fd3ef/kuadrant-console-plugin/0.log" Jul 08 00:33:07.180251 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:07.180159 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xkwsl_55543e66-2223-4105-91ad-bb5acd67b59a/registry-server/0.log" Jul 08 00:33:07.240763 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:07.240720 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-lk7rf_4c4cd3eb-27f0-4611-bc17-951d923aa085/manager/0.log" Jul 08 00:33:07.314439 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:07.314399 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-27b9r_c0dca58c-925d-4daa-8453-ba9a6b195d25/manager/0.log" Jul 08 00:33:09.031988 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.031927 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_707b377d-57d9-4de9-93d0-d5550bed7480/alertmanager/0.log" Jul 08 00:33:09.053387 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.053343 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_707b377d-57d9-4de9-93d0-d5550bed7480/config-reloader/0.log" Jul 08 00:33:09.082382 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.082266 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_707b377d-57d9-4de9-93d0-d5550bed7480/kube-rbac-proxy-web/0.log" Jul 08 00:33:09.104259 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.104229 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_707b377d-57d9-4de9-93d0-d5550bed7480/kube-rbac-proxy/0.log" Jul 08 00:33:09.129808 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.129775 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_707b377d-57d9-4de9-93d0-d5550bed7480/kube-rbac-proxy-metric/0.log" Jul 08 00:33:09.154874 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.154838 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_707b377d-57d9-4de9-93d0-d5550bed7480/prom-label-proxy/0.log" Jul 08 00:33:09.176009 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.175981 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_707b377d-57d9-4de9-93d0-d5550bed7480/init-config-reloader/0.log" Jul 08 00:33:09.336419 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.336384 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-svpfv_b3173619-4bfe-4aa0-b6d1-ae31945dbc99/monitoring-plugin/0.log" Jul 08 00:33:09.371802 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.371770 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jzzk_773dac9c-8211-4e49-91ec-254c1d120af3/node-exporter/0.log" Jul 08 00:33:09.390690 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.390659 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jzzk_773dac9c-8211-4e49-91ec-254c1d120af3/kube-rbac-proxy/0.log" Jul 08 00:33:09.419913 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.419884 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jzzk_773dac9c-8211-4e49-91ec-254c1d120af3/init-textfile/0.log" Jul 08 00:33:09.848128 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.846806 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-946lx_b6d301d8-9885-4c65-996c-9e67e7c6f669/prometheus-operator/0.log" Jul 08 00:33:09.870536 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.870426 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-946lx_b6d301d8-9885-4c65-996c-9e67e7c6f669/kube-rbac-proxy/0.log" Jul 08 00:33:09.897012 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.896498 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-86pfn_83399d8c-b35b-4557-b7e6-8927a8c87ddb/prometheus-operator-admission-webhook/0.log" Jul 08 00:33:09.932125 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.931727 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fbf4988d4-tbt4h_03e1a17e-0bca-4875-9f10-904f1e9e9706/telemeter-client/0.log" Jul 08 00:33:09.956826 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.956785 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fbf4988d4-tbt4h_03e1a17e-0bca-4875-9f10-904f1e9e9706/reload/0.log" Jul 08 00:33:09.976587 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:09.976555 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fbf4988d4-tbt4h_03e1a17e-0bca-4875-9f10-904f1e9e9706/kube-rbac-proxy/0.log" Jul 08 00:33:12.893506 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:12.893481 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fcf6b9994-gggvx_b3bac02b-5025-430a-b079-3b9c5c079038/console/0.log" Jul 08 00:33:12.934939 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:12.934908 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-928fx_df08d306-167b-4e1c-a522-215c079c4793/download-server/0.log" Jul 08 00:33:13.571461 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.571399 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp"] Jul 08 00:33:13.578521 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.578487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.587794 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.587764 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp"] Jul 08 00:33:13.732123 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.732028 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-lib-modules\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.732123 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.732081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhglp\" (UniqueName: \"kubernetes.io/projected/89ce32f3-6ead-46a1-86d0-2849380839bd-kube-api-access-qhglp\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.732123 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.732123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-sys\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.732398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.732171 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-proc\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.732398 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.732230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-podres\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.833886 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.833796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-lib-modules\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.833886 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.833849 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhglp\" (UniqueName: \"kubernetes.io/projected/89ce32f3-6ead-46a1-86d0-2849380839bd-kube-api-access-qhglp\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.833886 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.833881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-sys\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.834211 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.833914 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-proc\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.834211 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.833979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-podres\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.834211 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.833989 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-proc\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.834211 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.833996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-lib-modules\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.834211 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.833989 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-sys\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.834211 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.834139 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89ce32f3-6ead-46a1-86d0-2849380839bd-podres\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.842856 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.842820 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhglp\" (UniqueName: \"kubernetes.io/projected/89ce32f3-6ead-46a1-86d0-2849380839bd-kube-api-access-qhglp\") pod \"perf-node-gather-daemonset-vjmjp\" (UID: \"89ce32f3-6ead-46a1-86d0-2849380839bd\") " pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:13.895591 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:13.895345 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:14.130238 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:14.127411 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp"] Jul 08 00:33:14.131066 ip-10-0-128-26 kubenswrapper[2573]: W0708 00:33:14.131032 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod89ce32f3_6ead_46a1_86d0_2849380839bd.slice/crio-967b6c9dd4b33dde0bd9eaa0863d37da8cf38e4b2d0f2240c862e106034b9d72 WatchSource:0}: Error finding container 967b6c9dd4b33dde0bd9eaa0863d37da8cf38e4b2d0f2240c862e106034b9d72: Status 404 returned error can't find the container with id 967b6c9dd4b33dde0bd9eaa0863d37da8cf38e4b2d0f2240c862e106034b9d72 Jul 08 00:33:14.753479 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:14.753452 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8jbt_d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1/dns/0.log" Jul 08 00:33:14.772822 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:14.772785 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8jbt_d54be54e-8d3e-4cc2-b34f-3f7a06b0d3e1/kube-rbac-proxy/0.log" Jul 08 00:33:14.884388 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:14.884350 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5csdk_3f9f40b5-d352-40b4-a58f-3a72ed5a8ba6/dns-node-resolver/0.log" Jul 08 00:33:15.032293 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:15.032200 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" event={"ID":"89ce32f3-6ead-46a1-86d0-2849380839bd","Type":"ContainerStarted","Data":"8aed10d8750e156177f433d40180f676c60ca2485158668cd8acaf27a65fb820"} Jul 08 00:33:15.032293 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:15.032272 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" event={"ID":"89ce32f3-6ead-46a1-86d0-2849380839bd","Type":"ContainerStarted","Data":"967b6c9dd4b33dde0bd9eaa0863d37da8cf38e4b2d0f2240c862e106034b9d72"} Jul 08 00:33:15.032802 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:15.032632 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:15.050726 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:15.050661 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" podStartSLOduration=2.050642738 podStartE2EDuration="2.050642738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 00:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 00:33:15.049588279 +0000 UTC m=+1397.528433559" watchObservedRunningTime="2026-07-08 00:33:15.050642738 +0000 UTC m=+1397.529487998" Jul 08 00:33:15.431496 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:15.431461 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f578dfc4c-lt9hs_987a406c-c130-4cfe-a852-d5909b3b661e/registry/0.log" Jul 08 00:33:15.471172 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:15.471133 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kmm5f_81d26957-d758-4db7-a9e6-e04645877ec9/node-ca/0.log" Jul 08 00:33:16.487392 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:16.487364 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56857954bd-bmnwm_dc53a85c-3a1b-4f2d-bda0-48bda127ab8d/kube-auth-proxy/0.log" Jul 08 00:33:16.567889 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:16.567409 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ch8q8_1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac/payload-pre-processing/0.log" Jul 08 00:33:17.257490 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:17.257456 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xz689_0a93cca2-2333-4667-bd1d-20422aec61f3/serve-healthcheck-canary/0.log" Jul 08 00:33:17.841567 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:17.841485 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ns4jb_8e2a553f-466a-48c0-a8ed-23e1b790212e/kube-rbac-proxy/0.log" Jul 08 00:33:17.864591 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:17.864559 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ns4jb_8e2a553f-466a-48c0-a8ed-23e1b790212e/exporter/0.log" Jul 08 00:33:17.888143 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:17.888112 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ns4jb_8e2a553f-466a-48c0-a8ed-23e1b790212e/extractor/0.log" Jul 08 00:33:19.966926 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:19.966900 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tgvq6_cef62655-35a5-4b8e-b3b8-8f89aabf7a59/manager/0.log" Jul 08 00:33:20.010592 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:20.010561 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2mf8n_1c60a578-c233-444e-8bda-80bf5d7dced2/manager/0.log" Jul 08 00:33:20.043510 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:20.043478 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7887d4f798-trmvw_22589ad7-a32e-4512-a5b8-53ab93b87cdc/manager/0.log" Jul 08 00:33:20.259914 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:20.259831 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bdcc84df-vj47g_197f9eeb-bb24-463b-8dfe-5425866fe41c/manager/0.log" Jul 08 00:33:20.277293 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:20.277268 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bdcc84df-vj47g_197f9eeb-bb24-463b-8dfe-5425866fe41c/copy-manifests/0.log" Jul 08 00:33:21.053856 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:21.053807 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6jn5g/perf-node-gather-daemonset-vjmjp" Jul 08 00:33:21.426648 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:21.426563 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tzt2q_78bcfd08-94a6-478c-b1de-91a8a5eb949b/openshift-lws-operator/0.log" Jul 08 00:33:23.938005 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:23.937934 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56857954bd-bmnwm_dc53a85c-3a1b-4f2d-bda0-48bda127ab8d/kube-auth-proxy/0.log" Jul 08 00:33:24.000240 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:24.000204 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ch8q8_1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac/payload-pre-processing/0.log" Jul 08 00:33:25.310797 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:25.310699 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56857954bd-bmnwm_dc53a85c-3a1b-4f2d-bda0-48bda127ab8d/kube-auth-proxy/0.log" Jul 08 00:33:25.376790 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:25.376759 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ch8q8_1a31f0e6-a1c4-4b7e-abef-bab1fa1fc5ac/payload-pre-processing/0.log" Jul 08 00:33:26.796813 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:26.796785 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-898m5_f28e0a81-be80-406c-8f99-10baf8df959f/migrator/0.log" Jul 08 00:33:26.816626 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:26.816591 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-898m5_f28e0a81-be80-406c-8f99-10baf8df959f/graceful-termination/0.log" Jul 08 00:33:28.261548 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.261519 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmx4w_a460c5a9-6454-4f03-ad01-94be490f6344/kube-multus-additional-cni-plugins/0.log" Jul 08 00:33:28.282624 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.282597 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmx4w_a460c5a9-6454-4f03-ad01-94be490f6344/egress-router-binary-copy/0.log" Jul 08 00:33:28.301864 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.301835 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmx4w_a460c5a9-6454-4f03-ad01-94be490f6344/cni-plugins/0.log" Jul 08 00:33:28.320164 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.320131 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmx4w_a460c5a9-6454-4f03-ad01-94be490f6344/bond-cni-plugin/0.log" Jul 08 00:33:28.338260 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.338236 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmx4w_a460c5a9-6454-4f03-ad01-94be490f6344/routeoverride-cni/0.log" Jul 08 00:33:28.357871 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.357843 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmx4w_a460c5a9-6454-4f03-ad01-94be490f6344/whereabouts-cni-bincopy/0.log" Jul 08 00:33:28.377005 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.376966 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmx4w_a460c5a9-6454-4f03-ad01-94be490f6344/whereabouts-cni/0.log" Jul 08 00:33:28.575409 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.575376 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nr874_8c35106c-2c9b-4a81-b03f-801508924c93/kube-multus/0.log" Jul 08 00:33:28.657360 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.657318 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qv87q_ab3a86c6-12ef-4400-9c85-1263f4a7d02b/network-metrics-daemon/0.log" Jul 08 00:33:28.675026 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:28.674988 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qv87q_ab3a86c6-12ef-4400-9c85-1263f4a7d02b/kube-rbac-proxy/0.log" Jul 08 00:33:29.851655 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:29.851626 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zqqsq_5b32cce8-a1c1-44b0-8b28-510526961c3e/ovn-controller/0.log" Jul 08 00:33:29.869600 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:29.869551 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zqqsq_5b32cce8-a1c1-44b0-8b28-510526961c3e/ovn-acl-logging/0.log" Jul 08 00:33:29.889883 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:29.889857 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zqqsq_5b32cce8-a1c1-44b0-8b28-510526961c3e/kube-rbac-proxy-node/0.log" Jul 08 00:33:29.908674 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:29.908644 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zqqsq_5b32cce8-a1c1-44b0-8b28-510526961c3e/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 00:33:29.926798 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:29.926767 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zqqsq_5b32cce8-a1c1-44b0-8b28-510526961c3e/northd/0.log" Jul 08 00:33:29.945148 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:29.945118 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zqqsq_5b32cce8-a1c1-44b0-8b28-510526961c3e/nbdb/0.log" Jul 08 00:33:29.963974 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:29.963930 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zqqsq_5b32cce8-a1c1-44b0-8b28-510526961c3e/sbdb/0.log" Jul 08 00:33:30.009719 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:30.009688 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zqqsq_5b32cce8-a1c1-44b0-8b28-510526961c3e/ovnkube-controller/0.log" Jul 08 00:33:31.103952 ip-10-0-128-26 kubenswrapper[2573]: I0708 00:33:31.103915 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rztbr_1234d087-10b5-4aa2-85c0-1ba9291db5f0/network-check-target-container/0.log"