Jul 13 19:23:13.819964 ip-10-0-134-100 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 19:23:13.819974 ip-10-0-134-100 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 19:23:13.819981 ip-10-0-134-100 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 19:23:13.820199 ip-10-0-134-100 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 19:23:25.033987 ip-10-0-134-100 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 19:23:25.034008 ip-10-0-134-100 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 22199f1fad954b4584125a4a644939b0 -- Jul 13 19:25:28.830255 ip-10-0-134-100 systemd[1]: Starting Kubernetes Kubelet... Jul 13 19:25:29.282086 ip-10-0-134-100 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 19:25:29.282086 ip-10-0-134-100 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 19:25:29.282086 ip-10-0-134-100 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 19:25:29.282086 ip-10-0-134-100 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 19:25:29.282086 ip-10-0-134-100 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 19:25:29.283433 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.283344 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 19:25:29.288232 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288216 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:25:29.288232 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288231 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288235 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288238 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288241 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288246 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288251 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288256 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288260 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288263 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288266 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288269 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288272 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288275 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288277 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288280 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288287 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288290 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288293 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288295 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:25:29.288328 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288298 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288301 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288303 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288306 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288308 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288311 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288313 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288316 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288318 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288321 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288323 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288326 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288328 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288331 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288333 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288336 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288339 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288342 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288344 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288346 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:25:29.288770 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288348 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288351 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288354 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288356 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288359 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288362 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288365 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288367 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288369 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288373 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288376 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288378 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288381 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288383 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288386 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288389 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288392 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288394 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288397 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:25:29.289259 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288400 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288402 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288405 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288407 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288409 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288412 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288414 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288416 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288419 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288421 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288424 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288426 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288430 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288432 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288435 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288439 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288441 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288443 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288446 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288448 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:25:29.289710 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288451 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288453 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288455 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288458 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288460 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288463 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288465 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288468 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288471 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288473 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288476 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288479 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288481 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288484 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288487 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288489 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288491 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288494 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288496 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.288499 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:25:29.290195 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289194 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289201 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289205 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289208 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289211 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289214 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289217 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289219 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289222 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289225 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289227 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289230 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289232 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289234 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289237 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289239 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289242 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289244 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289248 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289251 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:25:29.290667 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289253 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289256 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289259 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289262 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289264 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289267 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289270 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289273 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289275 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289279 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289281 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289284 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289286 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289289 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289291 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289293 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289296 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289298 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289301 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289304 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:25:29.291183 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289307 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289309 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289312 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289314 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289318 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289321 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289324 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289327 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289330 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289333 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289335 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289338 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289340 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289343 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289345 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289348 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289350 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289353 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289355 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:25:29.291759 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289357 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289359 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289362 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289365 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289367 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289369 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289373 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289376 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289379 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289383 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289387 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289390 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289393 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289395 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289398 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289400 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289402 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289405 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289408 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:25:29.292253 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289410 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289413 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289416 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289418 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289421 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289423 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289425 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289428 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289431 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289433 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289436 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289439 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289441 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289443 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289445 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289448 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289450 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289452 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289455 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289457 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:25:29.292706 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289459 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289850 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289855 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289860 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289863 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289866 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289869 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289871 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289874 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289876 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289879 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289881 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289884 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289887 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289889 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289892 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289895 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289897 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289900 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289905 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:25:29.293220 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289908 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289910 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289912 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289915 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289917 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289919 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289922 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289924 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289928 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289932 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289935 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289937 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289940 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289942 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289945 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289947 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289950 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289953 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289958 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:25:29.293726 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289960 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289963 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289965 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289967 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289970 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289990 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289995 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.289998 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290001 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290003 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290006 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290009 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290013 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290016 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290018 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290022 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290026 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290028 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290031 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290033 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:25:29.294186 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290036 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290039 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290041 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290043 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290046 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290048 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290058 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290063 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290066 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290068 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290071 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290073 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290077 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290079 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290082 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290084 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290087 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290089 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290092 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:25:29.294668 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290095 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290097 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290100 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290102 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290105 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290108 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290111 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290113 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290116 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290118 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290121 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290123 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290125 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290128 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290130 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290132 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290135 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290137 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290140 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:25:29.295144 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290143 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290146 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290149 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290214 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290221 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290227 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290231 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290235 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290238 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290242 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290246 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290249 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290254 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290257 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290260 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290264 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290266 2555 flags.go:64] FLAG: --cgroup-root="" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290269 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290273 2555 flags.go:64] FLAG: --client-ca-file="" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290276 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290279 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290283 2555 flags.go:64] FLAG: --cluster-domain="" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290286 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290289 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 19:25:29.295584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290292 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290295 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290299 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290301 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290304 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290308 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290311 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290314 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290316 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290319 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290322 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290326 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290329 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290331 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290334 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290337 2555 flags.go:64] FLAG: --enable-server="true" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290340 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290344 2555 flags.go:64] FLAG: --event-burst="100" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290347 2555 flags.go:64] FLAG: --event-qps="50" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290350 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290354 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290357 2555 flags.go:64] FLAG: --eviction-hard="" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290360 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290363 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290366 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 19:25:29.296162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290369 2555 flags.go:64] FLAG: --eviction-soft="" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290372 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290375 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290378 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290381 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290383 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290386 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290389 2555 flags.go:64] FLAG: --feature-gates="" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290393 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290395 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290398 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290401 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290404 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290407 2555 flags.go:64] FLAG: --help="false" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290409 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290412 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290415 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290418 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290421 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290425 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290427 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290430 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290433 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 19:25:29.296746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290436 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290439 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290442 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290445 2555 flags.go:64] FLAG: --kube-reserved="" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290448 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290451 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290454 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290457 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290459 2555 flags.go:64] FLAG: --lock-file="" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290462 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290465 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290468 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290473 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290475 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290478 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290481 2555 flags.go:64] FLAG: --logging-format="text" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290483 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290486 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290489 2555 flags.go:64] FLAG: --manifest-url="" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290492 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290496 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290499 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290503 2555 flags.go:64] FLAG: --max-pods="110" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290505 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290508 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 19:25:29.297355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290511 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290514 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290517 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290520 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290522 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290529 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290533 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290535 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290538 2555 flags.go:64] FLAG: --pod-cidr="" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290541 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290546 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290549 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290553 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290556 2555 flags.go:64] FLAG: --port="10250" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290559 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290561 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-083ec56a29215fca4" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290565 2555 flags.go:64] FLAG: --qos-reserved="" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290567 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290570 2555 flags.go:64] FLAG: --register-node="true" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290573 2555 flags.go:64] FLAG: --register-with-taints="" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290576 2555 flags.go:64] FLAG: --registry-burst="10" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290579 2555 flags.go:64] FLAG: --registry-qps="5" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290582 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290584 2555 flags.go:64] FLAG: --reserved-memory="" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290588 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 19:25:29.297936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290591 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290594 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290596 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290599 2555 flags.go:64] FLAG: --runonce="false" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290601 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290604 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290607 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290610 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290612 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290615 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290618 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290621 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290623 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290626 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290629 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290632 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290635 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290638 2555 flags.go:64] FLAG: --system-cgroups="" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290641 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290647 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290650 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290652 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290657 2555 flags.go:64] FLAG: --tls-min-version="" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290661 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290664 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 19:25:29.298536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290667 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290669 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290672 2555 flags.go:64] FLAG: --v="2" Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290676 2555 flags.go:64] FLAG: --version="false" Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290680 2555 flags.go:64] FLAG: --vmodule="" Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290684 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.290687 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290800 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290803 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290806 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290811 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290814 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290817 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290820 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290822 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290825 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290827 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290830 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290832 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290835 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:25:29.299164 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290838 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290841 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290843 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290846 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290848 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290851 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290854 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290857 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290859 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290862 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290865 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290868 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290870 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290873 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290875 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290877 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290880 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290882 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290884 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290887 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:25:29.299637 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290889 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290892 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290894 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290897 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290900 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290902 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290904 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290918 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290922 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290926 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290929 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290932 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290935 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290938 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290941 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290943 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290946 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290948 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290953 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:25:29.300131 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290956 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290959 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290962 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290966 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290969 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290971 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290989 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290992 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290994 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290997 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.290999 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291002 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291005 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291007 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291010 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291012 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291015 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291017 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291020 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291022 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:25:29.300588 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291024 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291027 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291029 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291032 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291034 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291037 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291039 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291042 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291045 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291047 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291049 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291053 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291056 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291059 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291062 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291066 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291068 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291071 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291074 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:25:29.301118 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291076 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291079 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291081 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291083 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291086 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291088 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291091 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.291093 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.291744 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.298890 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.298916 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.298934 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.298943 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299016 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299022 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:25:29.301807 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299024 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299027 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299031 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299033 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299036 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299039 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299042 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299044 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299047 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299050 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299052 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299055 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299057 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299060 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299063 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299065 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299067 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299070 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299072 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299074 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:25:29.302326 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299077 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299079 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299082 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299084 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299086 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299089 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299091 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299100 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299103 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299105 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299108 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299110 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299113 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299117 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299121 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299125 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299128 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299132 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299134 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:25:29.302809 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299137 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299140 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299142 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299145 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299147 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299149 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299152 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299154 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299157 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299159 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299162 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299164 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299167 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299169 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299172 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299174 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299177 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299179 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299182 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299185 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:25:29.303380 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299188 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299195 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299203 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299206 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299208 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299211 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299213 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299216 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299218 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299221 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299223 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299226 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299228 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299230 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299233 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299235 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299238 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299240 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299242 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:25:29.303860 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299245 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299247 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299249 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299252 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299254 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299256 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299259 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299261 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299264 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299266 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299268 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299271 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299273 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299276 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299279 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299288 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299292 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299296 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:25:29.304473 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299298 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.299303 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299449 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299455 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299458 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299460 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299463 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299466 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299469 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299472 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299474 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299477 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299479 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299482 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299485 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 19:25:29.304933 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299487 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299490 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299492 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299494 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299497 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299499 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299503 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299506 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299509 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299511 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299514 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299516 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299519 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299521 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299524 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299532 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299534 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299537 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299539 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299541 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 19:25:29.305319 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299543 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299546 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299548 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299552 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299555 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299558 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299561 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299563 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299566 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299568 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299571 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299573 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299576 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299578 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299580 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299582 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299585 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299587 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299591 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 19:25:29.305785 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299594 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299596 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299599 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299602 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299605 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299608 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299610 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299612 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299615 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299623 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299626 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299628 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299630 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299632 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299635 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299638 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299641 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299643 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299646 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299648 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 19:25:29.306269 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299651 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299653 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299656 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299658 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299660 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299663 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299665 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299667 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299670 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299672 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299674 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299677 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299680 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299682 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299685 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299687 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299689 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299692 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299694 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299696 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 19:25:29.306752 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299699 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299702 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299709 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299712 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299714 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299716 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:29.299719 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.299723 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.299842 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.304120 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.305735 2555 server.go:1019] "Starting client certificate rotation" Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.305829 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 19:25:29.307244 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.305864 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 19:25:29.308533 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.308520 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 19:25:29.313165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.313149 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 19:25:29.325433 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.325413 2555 log.go:25] "Validated CRI v1 runtime API" Jul 13 19:25:29.327451 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.327436 2555 log.go:25] "Validated CRI v1 image API" Jul 13 19:25:29.328355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.328343 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 19:25:29.331136 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.331107 2555 fs.go:135] Filesystem UUIDs: map[30652555-eae2-4ad6-b5f5-fc9114048568:/dev/nvme0n1p3 71f001e9-26dd-4d42-b84e-af5539de40ac:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 13 19:25:29.331226 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.331134 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 19:25:29.336754 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.336639 2555 manager.go:216] Machine: {Timestamp:2026-07-13 19:25:29.336160262 +0000 UTC m=+0.382714543 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093289 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bae84e76af4ca0b57c31e55eb7d6c SystemUUID:ec2bae84-e76a-f4ca-0b57-c31e55eb7d6c BootID:22199f1f-ad95-4b45-8412-5a4a644939b0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2c:dd:64:30:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2c:dd:64:30:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:59:ca:96:5f:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 19:25:29.336754 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.336743 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 19:25:29.336911 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.336841 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 19:25:29.338030 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.337996 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 19:25:29.338161 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.338033 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 19:25:29.338690 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.338677 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 19:25:29.338690 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.338689 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 19:25:29.338769 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.338696 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 19:25:29.338769 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.338707 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 19:25:29.339957 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.339947 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 19:25:29.340766 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.340752 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 19:25:29.342743 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.342730 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 13 19:25:29.342866 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.342856 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 19:25:29.342920 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.342886 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 13 19:25:29.342920 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.342897 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 19:25:29.342920 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.342916 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 19:25:29.343053 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.342926 2555 kubelet.go:398] "Adding apiserver pod source" Jul 13 19:25:29.343053 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.342936 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 19:25:29.343301 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.343285 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 19:25:29.343301 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.343305 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 19:25:29.346118 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.346023 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 19:25:29.348624 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.348608 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 19:25:29.348716 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.348638 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 19:25:29.348809 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.348796 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 19:25:29.348857 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.348817 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 19:25:29.348857 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.348826 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 19:25:29.348857 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.348834 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 19:25:29.348857 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.348846 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 19:25:29.348857 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.348856 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 19:25:29.349543 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.349516 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 19:25:29.349543 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.349543 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 19:25:29.349605 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.349550 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 19:25:29.349605 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.349567 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 19:25:29.349605 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.349576 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 19:25:29.349605 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.349584 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 19:25:29.350147 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.350130 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 19:25:29.350178 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.350147 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 19:25:29.350314 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.350294 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 19:25:29.350405 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.350383 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 19:25:29.353661 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.353645 2555 server.go:1268] "Started kubelet" Jul 13 19:25:29.353763 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.353716 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 19:25:29.353827 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.353723 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 19:25:29.353827 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.353823 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 19:25:29.354218 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.354199 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 19:25:29.354672 ip-10-0-134-100 systemd[1]: Started Kubernetes Kubelet. Jul 13 19:25:29.355063 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.355037 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 19:25:29.356686 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.356666 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 13 19:25:29.359916 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.359899 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9mkqr" Jul 13 19:25:29.361470 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.361446 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 19:25:29.361553 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.361482 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 19:25:29.361606 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.361572 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 19:25:29.361606 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.361585 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:29.362270 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.362164 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 19:25:29.362270 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.362184 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 19:25:29.362270 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.362230 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 19:25:29.362270 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.362258 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 13 19:25:29.362270 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.362266 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 13 19:25:29.362579 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.361261 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-100.ec2.internal.18c1efed2cd11814 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-100.ec2.internal,UID:ip-10-0-134-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-100.ec2.internal,},FirstTimestamp:2026-07-13 19:25:29.35361538 +0000 UTC m=+0.400169642,LastTimestamp:2026-07-13 19:25:29.35361538 +0000 UTC m=+0.400169642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-100.ec2.internal,}" Jul 13 19:25:29.362784 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.362769 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 19:25:29.362830 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.362787 2555 factory.go:55] Registering systemd factory Jul 13 19:25:29.362830 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.362797 2555 factory.go:223] Registration of the systemd container factory successfully Jul 13 19:25:29.363053 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.363037 2555 factory.go:153] Registering CRI-O factory Jul 13 19:25:29.363053 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.363056 2555 factory.go:223] Registration of the crio container factory successfully Jul 13 19:25:29.363139 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.363079 2555 factory.go:103] Registering Raw factory Jul 13 19:25:29.363139 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.363094 2555 manager.go:1196] Started watching for new ooms in manager Jul 13 19:25:29.363757 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.363744 2555 manager.go:349] Starting recovery of all containers Jul 13 19:25:29.365492 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.365409 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9mkqr" Jul 13 19:25:29.366377 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.366326 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 19:25:29.366461 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.366416 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 19:25:29.376669 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.376477 2555 manager.go:354] Recovery completed Jul 13 19:25:29.382877 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.382860 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:25:29.384663 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.384646 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:25:29.384751 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.384683 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:25:29.384751 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.384697 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:25:29.385321 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.385309 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:25:29.385321 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.385317 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 19:25:29.385435 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.385329 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 19:25:29.385435 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.385345 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 13 19:25:29.386024 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.386011 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:25:29.386098 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.386040 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:25:29.386098 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.386054 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:25:29.386292 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.386280 2555 policy_none.go:49] "None policy: Start" Jul 13 19:25:29.386340 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.386300 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 19:25:29.386340 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.386311 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 19:25:29.387203 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.387192 2555 policy_none.go:47] "Start" Jul 13 19:25:29.426196 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.426183 2555 manager.go:337] "Starting Device Plugin manager" Jul 13 19:25:29.426279 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.426217 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 19:25:29.426279 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.426232 2555 server.go:87] "Starting device plugin registration server" Jul 13 19:25:29.426503 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.426491 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 19:25:29.426565 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.426504 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 19:25:29.426611 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.426600 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 19:25:29.426752 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.426684 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 19:25:29.426752 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.426703 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 19:25:29.427257 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.427240 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 19:25:29.427348 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.427283 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:29.527433 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.527408 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:25:29.528691 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.528333 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:25:29.528691 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.528362 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:25:29.528691 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.528373 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:25:29.528691 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.528399 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.536732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.536684 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.536732 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.536710 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-100.ec2.internal\": node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:29.541959 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.541935 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 19:25:29.543324 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.543306 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 19:25:29.543407 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.543351 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 19:25:29.543407 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.543400 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 19:25:29.543486 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.543440 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 19:25:29.545659 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.545638 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:25:29.551928 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.551911 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:29.643918 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.643881 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"] Jul 13 19:25:29.644106 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.643993 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:25:29.644935 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.644918 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:25:29.645016 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.644948 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:25:29.645016 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.644963 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:25:29.646345 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.646333 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:25:29.646486 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.646471 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.646521 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.646506 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:25:29.647070 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.647058 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:25:29.647130 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.647081 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:25:29.647130 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.647096 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:25:29.647190 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.647058 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:25:29.647190 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.647170 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:25:29.647190 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.647184 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:25:29.648374 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.648359 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.648374 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.648381 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 19:25:29.648956 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.648940 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory" Jul 13 19:25:29.649048 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.648966 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 19:25:29.649048 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.649001 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID" Jul 13 19:25:29.652055 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.652037 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:29.664725 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.664708 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/154c5327aa16f9370b08bb6afc50c2f4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-100.ec2.internal\" (UID: \"154c5327aa16f9370b08bb6afc50c2f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.664798 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.664732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c79db9e0088f021416e97154f40eb7a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"c79db9e0088f021416e97154f40eb7a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.664798 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.664747 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c79db9e0088f021416e97154f40eb7a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"c79db9e0088f021416e97154f40eb7a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.672516 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.672489 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-100.ec2.internal\" not found" node="ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.676711 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.676690 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-100.ec2.internal\" not found" node="ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.752112 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.752083 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:29.765143 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.765123 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c79db9e0088f021416e97154f40eb7a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"c79db9e0088f021416e97154f40eb7a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.765199 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.765148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c79db9e0088f021416e97154f40eb7a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"c79db9e0088f021416e97154f40eb7a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.765199 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.765165 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/154c5327aa16f9370b08bb6afc50c2f4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-100.ec2.internal\" (UID: \"154c5327aa16f9370b08bb6afc50c2f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.765199 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.765190 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/154c5327aa16f9370b08bb6afc50c2f4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-100.ec2.internal\" (UID: \"154c5327aa16f9370b08bb6afc50c2f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.765302 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.765212 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c79db9e0088f021416e97154f40eb7a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"c79db9e0088f021416e97154f40eb7a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.765302 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.765235 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c79db9e0088f021416e97154f40eb7a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"c79db9e0088f021416e97154f40eb7a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.852549 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.852473 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:29.952956 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:29.952922 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:29.975440 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.975421 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" Jul 13 19:25:29.979775 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:29.979588 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" Jul 13 19:25:30.053270 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:30.053243 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:30.153847 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:30.153784 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:30.255152 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:30.255114 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:30.307432 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.307403 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 19:25:30.307937 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.307622 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 19:25:30.355249 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:30.355221 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:30.368889 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.368855 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 19:20:29 +0000 UTC" deadline="2028-02-05 02:53:27.865620028 +0000 UTC" Jul 13 19:25:30.368889 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.368885 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13711h27m57.496737985s" Jul 13 19:25:30.456312 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:30.456226 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found" Jul 13 19:25:30.469193 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.469169 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:25:30.562439 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.562412 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" Jul 13 19:25:30.573836 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.573814 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 19:25:30.576040 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.576025 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" Jul 13 19:25:30.585268 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.585243 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 19:25:30.608881 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:30.608843 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod154c5327aa16f9370b08bb6afc50c2f4.slice/crio-4d3030d4ac55a7d99d5ebd0c7bc0e08ed0293c01e026cdc63b203bc5c110552d WatchSource:0}: Error finding container 4d3030d4ac55a7d99d5ebd0c7bc0e08ed0293c01e026cdc63b203bc5c110552d: Status 404 returned error can't find the container with id 4d3030d4ac55a7d99d5ebd0c7bc0e08ed0293c01e026cdc63b203bc5c110552d Jul 13 19:25:30.614696 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.614669 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 19:25:30.679542 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.679509 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:25:30.876939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:30.876856 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:25:31.344151 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.344067 2555 apiserver.go:52] "Watching apiserver" Jul 13 19:25:31.353546 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.353514 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 19:25:31.353996 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.353964 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-hmw6r","kube-system/global-pull-secret-syncer-mc8s4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc","openshift-cluster-node-tuning-operator/tuned-498ml","openshift-image-registry/node-ca-m9wqk","openshift-multus/multus-additional-cni-plugins-t88hs","openshift-multus/multus-wg8bt","openshift-multus/network-metrics-daemon-rm67z","openshift-network-diagnostics/network-check-target-dfsp6","kube-system/konnectivity-agent-kntpt","kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal","openshift-dns/node-resolver-t877d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal","openshift-network-operator/iptables-alerter-vvrkv"] Jul 13 19:25:31.355681 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.355656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.356964 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.356941 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:31.357144 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.357037 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:31.358205 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.358187 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.358779 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.358759 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 19:25:31.358779 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.358769 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 19:25:31.359060 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.359027 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 19:25:31.359416 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.359396 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5mptp\"" Jul 13 19:25:31.359511 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.359448 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.360660 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.360640 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 19:25:31.361097 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.360953 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 19:25:31.361097 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.361005 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.361736 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.361712 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 19:25:31.361923 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.361908 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 19:25:31.362278 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.362261 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f8nv8\"" Jul 13 19:25:31.362604 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.362584 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8xmwg\"" Jul 13 19:25:31.362962 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.362946 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.363313 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.363299 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 19:25:31.363820 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.363642 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 19:25:31.363820 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.363716 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:25:31.364052 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.364033 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:31.364134 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.364101 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:31.364755 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.364323 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 19:25:31.364755 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.364520 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hwpk8\"" Jul 13 19:25:31.364755 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.364566 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 19:25:31.364755 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.364590 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 19:25:31.365442 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.365426 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.366456 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.366440 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 19:25:31.366648 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.366572 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 19:25:31.366648 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.366439 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vntvl\"" Jul 13 19:25:31.366762 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.366714 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:31.366817 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.366791 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:31.368396 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.368139 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:31.368396 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.368217 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 19:25:31.368659 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.368638 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 19:25:31.368659 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.368710 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 19:25:31.368942 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.368720 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 19:25:31.369666 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.369649 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.370276 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.370252 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 19:25:31.370411 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.370287 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 19:25:31.370528 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.370506 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9g4cz\"" Jul 13 19:25:31.371165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.371144 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.371410 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.371392 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-67wxc\"" Jul 13 19:25:31.371657 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.371636 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 19:25:31.371766 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.371710 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373364 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373429 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373561 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-sysctl-d\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373581 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-cnibin\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373604 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-cni-binary-copy\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-var-lib-kubelet\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kv85\" (UniqueName: \"kubernetes.io/projected/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-kube-api-access-5kv85\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373708 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373730 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04f68363-e7c2-4de9-bbb8-969765564cfb-tmp\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373746 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-registration-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373763 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-run-multus-certs\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373779 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fcgg\" (UniqueName: \"kubernetes.io/projected/9fa025d1-cdfb-41a5-80df-50795d7b36f9-kube-api-access-9fcgg\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-kubernetes\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373821 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjm5t\" (UniqueName: \"kubernetes.io/projected/04f68363-e7c2-4de9-bbb8-969765564cfb-kube-api-access-vjm5t\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-socket-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373894 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-hostroot\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-systemd\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.374022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.373988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-sys\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.374976 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.374020 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-host\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.374976 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.374052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.374976 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.374089 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.374976 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.374601 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnzsl\" (UniqueName: \"kubernetes.io/projected/be85543b-0c22-425e-bc2b-0d5784529e5d-kube-api-access-jnzsl\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.374976 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.374809 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 19:25:31.374976 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.374840 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 19:25:31.375196 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.375067 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ckp9l\"" Jul 13 19:25:31.375331 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.375314 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 19:25:31.377552 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377532 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-os-release\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.377661 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377595 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ldd2f\"" Jul 13 19:25:31.377661 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377604 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-run-k8s-cni-cncf-io\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.377775 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-run-netns\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.377775 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-var-lib-cni-bin\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.377775 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377762 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-os-release\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.377921 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377836 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-var-lib-cni-multus\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.377921 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-etc-kubernetes\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.378051 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377946 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-var-lib-kubelet\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.378051 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.377978 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-sys-fs\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.378144 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378003 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75d81a4e-0023-445d-bbee-336e39407e8c-host\") pod \"node-ca-m9wqk\" (UID: \"75d81a4e-0023-445d-bbee-336e39407e8c\") " pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.378144 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be85543b-0c22-425e-bc2b-0d5784529e5d-cni-binary-copy\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.378144 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378129 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-system-cni-dir\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.378280 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378159 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-modprobe-d\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.378280 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-sysconfig\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.378360 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378272 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-run\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.378360 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378312 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g6wk\" (UniqueName: \"kubernetes.io/projected/0d88543b-1c99-46cd-bf80-e6fd0362389d-kube-api-access-9g6wk\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.378426 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be85543b-0c22-425e-bc2b-0d5784529e5d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.378461 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be85543b-0c22-425e-bc2b-0d5784529e5d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.378494 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378470 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-conf-dir\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.378526 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378496 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-daemon-config\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.378594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378546 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-tuned\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.378658 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378623 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:31.378713 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378654 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75d81a4e-0023-445d-bbee-336e39407e8c-serviceca\") pod \"node-ca-m9wqk\" (UID: \"75d81a4e-0023-445d-bbee-336e39407e8c\") " pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.378713 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378688 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg6ff\" (UniqueName: \"kubernetes.io/projected/75d81a4e-0023-445d-bbee-336e39407e8c-kube-api-access-cg6ff\") pod \"node-ca-m9wqk\" (UID: \"75d81a4e-0023-445d-bbee-336e39407e8c\") " pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.378805 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378750 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-system-cni-dir\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.378842 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378805 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-cni-dir\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.378881 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378862 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-socket-dir-parent\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.378924 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-sysctl-conf\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.378974 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.378963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-lib-modules\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.379032 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.379019 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-device-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.379087 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.379044 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-etc-selinux\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.379087 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.379065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-cnibin\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.382020 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.381990 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 19:25:31.400472 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.400448 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x6v5r" Jul 13 19:25:31.409735 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.409716 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x6v5r" Jul 13 19:25:31.463662 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.463631 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 19:25:31.479876 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.479841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:31.480041 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.479883 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-cni-dir\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.480041 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.479905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-socket-dir-parent\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.480041 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.479930 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-lib-modules\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.480041 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.479955 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-device-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.480041 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.479979 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82098306-9d22-4632-91bd-bc066d450d55-konnectivity-ca\") pod \"konnectivity-agent-kntpt\" (UID: \"82098306-9d22-4632-91bd-bc066d450d55\") " pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:31.480041 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-systemd-units\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.480041 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480041 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35273a9e-cd1d-45ff-974f-1111d3941390-ovnkube-config\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480043 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-socket-dir-parent\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-cni-binary-copy\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480118 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-cni-dir\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480122 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04f68363-e7c2-4de9-bbb8-969765564cfb-tmp\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480165 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-registration-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480192 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-run-ovn-kubernetes\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f88c638-9d92-4e40-aa7f-620014bb4134-kubelet-config\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480236 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-device-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480254 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-run-multus-certs\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480278 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fcgg\" (UniqueName: \"kubernetes.io/projected/9fa025d1-cdfb-41a5-80df-50795d7b36f9-kube-api-access-9fcgg\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480304 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-kubernetes\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480329 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjm5t\" (UniqueName: \"kubernetes.io/projected/04f68363-e7c2-4de9-bbb8-969765564cfb-kube-api-access-vjm5t\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj74q\" (UniqueName: \"kubernetes.io/projected/3a880dc9-d62a-455d-a46b-09e03d167960-kube-api-access-jj74q\") pod \"node-resolver-t877d\" (UID: \"3a880dc9-d62a-455d-a46b-09e03d167960\") " pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480381 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-var-lib-openvswitch\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480405 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-log-socket\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.480429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480433 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-systemd\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480443 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-run-multus-certs\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480193 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-lib-modules\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480481 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-sys\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480515 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-systemd\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480517 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-os-release\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480527 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-kubernetes\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480576 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-var-lib-cni-bin\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480583 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-registration-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480622 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-os-release\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480668 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f695c22-08df-468c-9050-dadead4b1556-host-slash\") pod \"iptables-alerter-vvrkv\" (UID: \"1f695c22-08df-468c-9050-dadead4b1556\") " pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-kubelet\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480718 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-sys\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480727 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-var-lib-cni-bin\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480750 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35273a9e-cd1d-45ff-974f-1111d3941390-env-overrides\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480806 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-sys-fs\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480833 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480867 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75d81a4e-0023-445d-bbee-336e39407e8c-host\") pod \"node-ca-m9wqk\" (UID: \"75d81a4e-0023-445d-bbee-336e39407e8c\") " pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.481165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480887 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75d81a4e-0023-445d-bbee-336e39407e8c-host\") pod \"node-ca-m9wqk\" (UID: \"75d81a4e-0023-445d-bbee-336e39407e8c\") " pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480892 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-cni-binary-copy\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480961 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f695c22-08df-468c-9050-dadead4b1556-iptables-alerter-script\") pod \"iptables-alerter-vvrkv\" (UID: \"1f695c22-08df-468c-9050-dadead4b1556\") " pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480999 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-run-openvswitch\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.480961 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-sys-fs\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481021 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f88c638-9d92-4e40-aa7f-620014bb4134-dbus\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481046 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-sysconfig\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be85543b-0c22-425e-bc2b-0d5784529e5d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481083 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82098306-9d22-4632-91bd-bc066d450d55-agent-certs\") pod \"konnectivity-agent-kntpt\" (UID: \"82098306-9d22-4632-91bd-bc066d450d55\") " pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481085 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-sysconfig\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481105 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-tuned\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481132 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75d81a4e-0023-445d-bbee-336e39407e8c-serviceca\") pod \"node-ca-m9wqk\" (UID: \"75d81a4e-0023-445d-bbee-336e39407e8c\") " pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481158 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg6ff\" (UniqueName: \"kubernetes.io/projected/75d81a4e-0023-445d-bbee-336e39407e8c-kube-api-access-cg6ff\") pod \"node-ca-m9wqk\" (UID: \"75d81a4e-0023-445d-bbee-336e39407e8c\") " pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481184 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-cni-bin\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481242 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481271 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35273a9e-cd1d-45ff-974f-1111d3941390-ovn-node-metrics-cert\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481317 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-sysctl-conf\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.481844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481340 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-etc-selinux\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481368 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-cnibin\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481392 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-slash\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481526 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-sysctl-conf\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481526 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-etc-selinux\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481585 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-cnibin\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481612 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-run-ovn\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481634 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-cni-netd\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481660 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35273a9e-cd1d-45ff-974f-1111d3941390-ovnkube-script-lib\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481676 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/75d81a4e-0023-445d-bbee-336e39407e8c-serviceca\") pod \"node-ca-m9wqk\" (UID: \"75d81a4e-0023-445d-bbee-336e39407e8c\") " pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481658 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be85543b-0c22-425e-bc2b-0d5784529e5d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481689 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-sysctl-d\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481732 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-cnibin\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-var-lib-kubelet\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481785 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kv85\" (UniqueName: \"kubernetes.io/projected/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-kube-api-access-5kv85\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481811 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481836 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-cnibin\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481840 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-sysctl-d\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.482838 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.481919 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481838 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-run-systemd\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.481955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-node-log\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.481979 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:31.981960831 +0000 UTC m=+3.028515082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-socket-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482127 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-hostroot\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-host\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482187 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482210 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-hostroot\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482219 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482246 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnzsl\" (UniqueName: \"kubernetes.io/projected/be85543b-0c22-425e-bc2b-0d5784529e5d-kube-api-access-jnzsl\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8cwp\" (UniqueName: \"kubernetes.io/projected/1f695c22-08df-468c-9050-dadead4b1556-kube-api-access-h8cwp\") pod \"iptables-alerter-vvrkv\" (UID: \"1f695c22-08df-468c-9050-dadead4b1556\") " pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482274 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-host\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482299 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482243 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d88543b-1c99-46cd-bf80-e6fd0362389d-socket-dir\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482429 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.483732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482435 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-run-k8s-cni-cncf-io\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-run-netns\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482488 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-run-k8s-cni-cncf-io\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-os-release\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482524 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-var-lib-kubelet\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482526 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-run-netns\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-etc-openvswitch\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482575 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-os-release\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482603 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqktd\" (UniqueName: \"kubernetes.io/projected/35273a9e-cd1d-45ff-974f-1111d3941390-kube-api-access-tqktd\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482634 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-var-lib-cni-multus\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482659 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-etc-kubernetes\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482687 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-var-lib-kubelet\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482694 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-host-var-lib-cni-multus\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482712 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be85543b-0c22-425e-bc2b-0d5784529e5d-cni-binary-copy\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482731 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-etc-kubernetes\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482739 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be85543b-0c22-425e-bc2b-0d5784529e5d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482761 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-system-cni-dir\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.484594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-modprobe-d\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482785 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-var-lib-kubelet\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482792 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-run\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482834 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-system-cni-dir\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482849 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-run\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482867 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g6wk\" (UniqueName: \"kubernetes.io/projected/0d88543b-1c99-46cd-bf80-e6fd0362389d-kube-api-access-9g6wk\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482896 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-run-netns\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482923 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-conf-dir\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482939 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-modprobe-d\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482952 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-daemon-config\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.482980 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.483030 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-system-cni-dir\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.483060 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a880dc9-d62a-455d-a46b-09e03d167960-hosts-file\") pod \"node-resolver-t877d\" (UID: \"3a880dc9-d62a-455d-a46b-09e03d167960\") " pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.483086 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a880dc9-d62a-455d-a46b-09e03d167960-tmp-dir\") pod \"node-resolver-t877d\" (UID: \"3a880dc9-d62a-455d-a46b-09e03d167960\") " pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.483182 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-conf-dir\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.483232 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be85543b-0c22-425e-bc2b-0d5784529e5d-cni-binary-copy\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.483311 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be85543b-0c22-425e-bc2b-0d5784529e5d-system-cni-dir\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.485289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.483387 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be85543b-0c22-425e-bc2b-0d5784529e5d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.485980 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.483609 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-multus-daemon-config\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.486302 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.486268 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04f68363-e7c2-4de9-bbb8-969765564cfb-etc-tuned\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.486417 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.486306 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04f68363-e7c2-4de9-bbb8-969765564cfb-tmp\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.492500 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.492471 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fcgg\" (UniqueName: \"kubernetes.io/projected/9fa025d1-cdfb-41a5-80df-50795d7b36f9-kube-api-access-9fcgg\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:31.494500 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.494476 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:25:31.494500 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.494502 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:25:31.494674 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.494516 2555 projected.go:196] Error preparing data for projected volume kube-api-access-p5fsp for pod openshift-network-diagnostics/network-check-target-dfsp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:31.494674 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.494591 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp podName:1b04d793-b0c3-438f-a62a-4a297bea54bc nodeName:}" failed. No retries permitted until 2026-07-13 19:25:31.994559345 +0000 UTC m=+3.041113635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p5fsp" (UniqueName: "kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp") pod "network-check-target-dfsp6" (UID: "1b04d793-b0c3-438f-a62a-4a297bea54bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:31.495208 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.495187 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g6wk\" (UniqueName: \"kubernetes.io/projected/0d88543b-1c99-46cd-bf80-e6fd0362389d-kube-api-access-9g6wk\") pod \"aws-ebs-csi-driver-node-tqdtc\" (UID: \"0d88543b-1c99-46cd-bf80-e6fd0362389d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.495941 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.495917 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnzsl\" (UniqueName: \"kubernetes.io/projected/be85543b-0c22-425e-bc2b-0d5784529e5d-kube-api-access-jnzsl\") pod \"multus-additional-cni-plugins-t88hs\" (UID: \"be85543b-0c22-425e-bc2b-0d5784529e5d\") " pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.496599 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.496574 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjm5t\" (UniqueName: \"kubernetes.io/projected/04f68363-e7c2-4de9-bbb8-969765564cfb-kube-api-access-vjm5t\") pod \"tuned-498ml\" (UID: \"04f68363-e7c2-4de9-bbb8-969765564cfb\") " pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.497926 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.497901 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg6ff\" (UniqueName: \"kubernetes.io/projected/75d81a4e-0023-445d-bbee-336e39407e8c-kube-api-access-cg6ff\") pod \"node-ca-m9wqk\" (UID: \"75d81a4e-0023-445d-bbee-336e39407e8c\") " pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.498022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.497926 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kv85\" (UniqueName: \"kubernetes.io/projected/f1c25a20-9a76-49e9-a5fe-b4ab031600d9-kube-api-access-5kv85\") pod \"multus-wg8bt\" (UID: \"f1c25a20-9a76-49e9-a5fe-b4ab031600d9\") " pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.550918 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.550864 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" event={"ID":"154c5327aa16f9370b08bb6afc50c2f4","Type":"ContainerStarted","Data":"4d3030d4ac55a7d99d5ebd0c7bc0e08ed0293c01e026cdc63b203bc5c110552d"} Jul 13 19:25:31.552056 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.552020 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" event={"ID":"c79db9e0088f021416e97154f40eb7a5","Type":"ContainerStarted","Data":"067ecaaa9da99c85f1386c6a651b7609ffb88a3470e110314d5a757f9183e7e0"} Jul 13 19:25:31.583622 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583593 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-run-systemd\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.583752 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583627 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-node-log\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.583752 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583649 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8cwp\" (UniqueName: \"kubernetes.io/projected/1f695c22-08df-468c-9050-dadead4b1556-kube-api-access-h8cwp\") pod \"iptables-alerter-vvrkv\" (UID: \"1f695c22-08df-468c-9050-dadead4b1556\") " pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.583752 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583700 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-node-log\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.583752 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583726 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-etc-openvswitch\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.583752 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqktd\" (UniqueName: \"kubernetes.io/projected/35273a9e-cd1d-45ff-974f-1111d3941390-kube-api-access-tqktd\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.583988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583720 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-run-systemd\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.583988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583778 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-etc-openvswitch\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.583988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583799 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-run-netns\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.583988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583842 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-run-netns\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.583988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583934 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a880dc9-d62a-455d-a46b-09e03d167960-hosts-file\") pod \"node-resolver-t877d\" (UID: \"3a880dc9-d62a-455d-a46b-09e03d167960\") " pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.583988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.583961 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a880dc9-d62a-455d-a46b-09e03d167960-tmp-dir\") pod \"node-resolver-t877d\" (UID: \"3a880dc9-d62a-455d-a46b-09e03d167960\") " pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.583988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584008 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:31.583988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82098306-9d22-4632-91bd-bc066d450d55-konnectivity-ca\") pod \"konnectivity-agent-kntpt\" (UID: \"82098306-9d22-4632-91bd-bc066d450d55\") " pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-systemd-units\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584088 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35273a9e-cd1d-45ff-974f-1111d3941390-ovnkube-config\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584097 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a880dc9-d62a-455d-a46b-09e03d167960-hosts-file\") pod \"node-resolver-t877d\" (UID: \"3a880dc9-d62a-455d-a46b-09e03d167960\") " pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584114 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-run-ovn-kubernetes\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.584127 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584141 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f88c638-9d92-4e40-aa7f-620014bb4134-kubelet-config\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584152 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-systemd-units\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584180 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj74q\" (UniqueName: \"kubernetes.io/projected/3a880dc9-d62a-455d-a46b-09e03d167960-kube-api-access-jj74q\") pod \"node-resolver-t877d\" (UID: \"3a880dc9-d62a-455d-a46b-09e03d167960\") " pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.584198 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret podName:7f88c638-9d92-4e40-aa7f-620014bb4134 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:32.084175291 +0000 UTC m=+3.130729562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret") pod "global-pull-secret-syncer-mc8s4" (UID: "7f88c638-9d92-4e40-aa7f-620014bb4134") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584235 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-var-lib-openvswitch\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584273 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-log-socket\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584306 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f695c22-08df-468c-9050-dadead4b1556-host-slash\") pod \"iptables-alerter-vvrkv\" (UID: \"1f695c22-08df-468c-9050-dadead4b1556\") " pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584330 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-kubelet\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35273a9e-cd1d-45ff-974f-1111d3941390-env-overrides\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584386 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f695c22-08df-468c-9050-dadead4b1556-iptables-alerter-script\") pod \"iptables-alerter-vvrkv\" (UID: \"1f695c22-08df-468c-9050-dadead4b1556\") " pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584391 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a880dc9-d62a-455d-a46b-09e03d167960-tmp-dir\") pod \"node-resolver-t877d\" (UID: \"3a880dc9-d62a-455d-a46b-09e03d167960\") " pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.584636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584411 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-run-ovn-kubernetes\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584424 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-run-openvswitch\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584449 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f88c638-9d92-4e40-aa7f-620014bb4134-dbus\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584456 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f695c22-08df-468c-9050-dadead4b1556-host-slash\") pod \"iptables-alerter-vvrkv\" (UID: \"1f695c22-08df-468c-9050-dadead4b1556\") " pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584483 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82098306-9d22-4632-91bd-bc066d450d55-agent-certs\") pod \"konnectivity-agent-kntpt\" (UID: \"82098306-9d22-4632-91bd-bc066d450d55\") " pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584509 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f88c638-9d92-4e40-aa7f-620014bb4134-kubelet-config\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584514 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-cni-bin\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584567 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-cni-bin\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584580 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584613 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35273a9e-cd1d-45ff-974f-1111d3941390-ovn-node-metrics-cert\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584644 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-slash\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584661 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-var-lib-openvswitch\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584668 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82098306-9d22-4632-91bd-bc066d450d55-konnectivity-ca\") pod \"konnectivity-agent-kntpt\" (UID: \"82098306-9d22-4632-91bd-bc066d450d55\") " pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584613 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-kubelet\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584706 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584717 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-run-ovn\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584746 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-slash\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.585519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584748 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35273a9e-cd1d-45ff-974f-1111d3941390-ovnkube-config\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584763 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-log-socket\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584670 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-run-ovn\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584812 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-run-openvswitch\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584904 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f88c638-9d92-4e40-aa7f-620014bb4134-dbus\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584949 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-cni-netd\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.584988 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35273a9e-cd1d-45ff-974f-1111d3941390-ovnkube-script-lib\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.585033 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35273a9e-cd1d-45ff-974f-1111d3941390-env-overrides\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.585078 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35273a9e-cd1d-45ff-974f-1111d3941390-host-cni-netd\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.585330 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f695c22-08df-468c-9050-dadead4b1556-iptables-alerter-script\") pod \"iptables-alerter-vvrkv\" (UID: \"1f695c22-08df-468c-9050-dadead4b1556\") " pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.586194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.585613 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35273a9e-cd1d-45ff-974f-1111d3941390-ovnkube-script-lib\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.587842 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.587320 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35273a9e-cd1d-45ff-974f-1111d3941390-ovn-node-metrics-cert\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.587842 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.587743 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82098306-9d22-4632-91bd-bc066d450d55-agent-certs\") pod \"konnectivity-agent-kntpt\" (UID: \"82098306-9d22-4632-91bd-bc066d450d55\") " pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:31.594558 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.594498 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8cwp\" (UniqueName: \"kubernetes.io/projected/1f695c22-08df-468c-9050-dadead4b1556-kube-api-access-h8cwp\") pod \"iptables-alerter-vvrkv\" (UID: \"1f695c22-08df-468c-9050-dadead4b1556\") " pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.594874 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.594849 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqktd\" (UniqueName: \"kubernetes.io/projected/35273a9e-cd1d-45ff-974f-1111d3941390-kube-api-access-tqktd\") pod \"ovnkube-node-hmw6r\" (UID: \"35273a9e-cd1d-45ff-974f-1111d3941390\") " pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.594977 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.594962 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj74q\" (UniqueName: \"kubernetes.io/projected/3a880dc9-d62a-455d-a46b-09e03d167960-kube-api-access-jj74q\") pod \"node-resolver-t877d\" (UID: \"3a880dc9-d62a-455d-a46b-09e03d167960\") " pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.669022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.668973 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wg8bt" Jul 13 19:25:31.680104 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.680083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" Jul 13 19:25:31.689187 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.689171 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-498ml" Jul 13 19:25:31.693850 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.693830 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m9wqk" Jul 13 19:25:31.701611 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.701593 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t88hs" Jul 13 19:25:31.708409 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.708394 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:31.715345 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.715320 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:31.722157 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.722140 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vvrkv" Jul 13 19:25:31.728896 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.728879 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t877d" Jul 13 19:25:31.739794 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.739778 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 19:25:31.988425 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:31.988343 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:31.988578 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.988523 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:31.988621 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:31.988599 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:32.988584128 +0000 UTC m=+4.035138382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:32.089713 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.089673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:32.089713 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.089721 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:32.089913 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:32.089853 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:25:32.089913 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:32.089859 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:32.089913 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:32.089876 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:25:32.089913 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:32.089887 2555 projected.go:196] Error preparing data for projected volume kube-api-access-p5fsp for pod openshift-network-diagnostics/network-check-target-dfsp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:32.090051 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:32.089925 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret podName:7f88c638-9d92-4e40-aa7f-620014bb4134 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:33.089908686 +0000 UTC m=+4.136462941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret") pod "global-pull-secret-syncer-mc8s4" (UID: "7f88c638-9d92-4e40-aa7f-620014bb4134") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:32.090051 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:32.089940 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp podName:1b04d793-b0c3-438f-a62a-4a297bea54bc nodeName:}" failed. No retries permitted until 2026-07-13 19:25:33.089933944 +0000 UTC m=+4.136488193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5fsp" (UniqueName: "kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp") pod "network-check-target-dfsp6" (UID: "1b04d793-b0c3-438f-a62a-4a297bea54bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:32.247734 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:32.247512 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f68363_e7c2_4de9_bbb8_969765564cfb.slice/crio-224daa468288fff0058cf154abc78c0f71c90dc307001c40c3cc8aba57057cce WatchSource:0}: Error finding container 224daa468288fff0058cf154abc78c0f71c90dc307001c40c3cc8aba57057cce: Status 404 returned error can't find the container with id 224daa468288fff0058cf154abc78c0f71c90dc307001c40c3cc8aba57057cce Jul 13 19:25:32.250276 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:32.250242 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe85543b_0c22_425e_bc2b_0d5784529e5d.slice/crio-8b9f69fc309e1c5be4398270cb0568f6397cf007422dc1652cbb0db098184def WatchSource:0}: Error finding container 8b9f69fc309e1c5be4398270cb0568f6397cf007422dc1652cbb0db098184def: Status 404 returned error can't find the container with id 8b9f69fc309e1c5be4398270cb0568f6397cf007422dc1652cbb0db098184def Jul 13 19:25:32.256780 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:32.256713 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f695c22_08df_468c_9050_dadead4b1556.slice/crio-ce3c787a744c2562e8779b6f8f7822f035c35c490d4ca76d6b608aa0e5914131 WatchSource:0}: Error finding container ce3c787a744c2562e8779b6f8f7822f035c35c490d4ca76d6b608aa0e5914131: Status 404 returned error can't find the container with id ce3c787a744c2562e8779b6f8f7822f035c35c490d4ca76d6b608aa0e5914131 Jul 13 19:25:32.257559 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:32.257533 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82098306_9d22_4632_91bd_bc066d450d55.slice/crio-b32ddb78be46793668352438383c598f0264af40cf5edecfabfa97bd17d95e5c WatchSource:0}: Error finding container b32ddb78be46793668352438383c598f0264af40cf5edecfabfa97bd17d95e5c: Status 404 returned error can't find the container with id b32ddb78be46793668352438383c598f0264af40cf5edecfabfa97bd17d95e5c Jul 13 19:25:32.271680 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:32.271644 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a880dc9_d62a_455d_a46b_09e03d167960.slice/crio-4c383cba50a750369d39c0ce3eb5afaf4316d95e21a4c1cd7bd1137765d14190 WatchSource:0}: Error finding container 4c383cba50a750369d39c0ce3eb5afaf4316d95e21a4c1cd7bd1137765d14190: Status 404 returned error can't find the container with id 4c383cba50a750369d39c0ce3eb5afaf4316d95e21a4c1cd7bd1137765d14190 Jul 13 19:25:32.272987 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:32.272952 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35273a9e_cd1d_45ff_974f_1111d3941390.slice/crio-97cd13ad5837e600952de0c365410f5aeca56748e64a52b7ff335c4bf7f0c909 WatchSource:0}: Error finding container 97cd13ad5837e600952de0c365410f5aeca56748e64a52b7ff335c4bf7f0c909: Status 404 returned error can't find the container with id 97cd13ad5837e600952de0c365410f5aeca56748e64a52b7ff335c4bf7f0c909 Jul 13 19:25:32.275212 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:32.274551 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d88543b_1c99_46cd_bf80_e6fd0362389d.slice/crio-36580fc3e22e3fdcc983f8a720d671bdec080c2f06e25c9698824dffb72491f4 WatchSource:0}: Error finding container 36580fc3e22e3fdcc983f8a720d671bdec080c2f06e25c9698824dffb72491f4: Status 404 returned error can't find the container with id 36580fc3e22e3fdcc983f8a720d671bdec080c2f06e25c9698824dffb72491f4 Jul 13 19:25:32.276814 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:32.276792 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c25a20_9a76_49e9_a5fe_b4ab031600d9.slice/crio-4665af8a2b8fcf543760a1149517cb6c1a2b197470bdace2e190557df5b10721 WatchSource:0}: Error finding container 4665af8a2b8fcf543760a1149517cb6c1a2b197470bdace2e190557df5b10721: Status 404 returned error can't find the container with id 4665af8a2b8fcf543760a1149517cb6c1a2b197470bdace2e190557df5b10721 Jul 13 19:25:32.277613 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:25:32.277569 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d81a4e_0023_445d_bbee_336e39407e8c.slice/crio-c75f3e87659cef5e977794814bfa71ff9899edbe208ea5580e27cdbfbc7547a5 WatchSource:0}: Error finding container c75f3e87659cef5e977794814bfa71ff9899edbe208ea5580e27cdbfbc7547a5: Status 404 returned error can't find the container with id c75f3e87659cef5e977794814bfa71ff9899edbe208ea5580e27cdbfbc7547a5 Jul 13 19:25:32.412823 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.412664 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 19:20:31 +0000 UTC" deadline="2028-02-13 20:11:16.2475644 +0000 UTC" Jul 13 19:25:32.412823 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.412824 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13920h45m43.834744467s" Jul 13 19:25:32.543920 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.543812 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:32.544079 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:32.543972 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:32.555322 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.555251 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t877d" event={"ID":"3a880dc9-d62a-455d-a46b-09e03d167960","Type":"ContainerStarted","Data":"4c383cba50a750369d39c0ce3eb5afaf4316d95e21a4c1cd7bd1137765d14190"} Jul 13 19:25:32.556473 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.556423 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-498ml" event={"ID":"04f68363-e7c2-4de9-bbb8-969765564cfb","Type":"ContainerStarted","Data":"224daa468288fff0058cf154abc78c0f71c90dc307001c40c3cc8aba57057cce"} Jul 13 19:25:32.557615 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.557583 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m9wqk" event={"ID":"75d81a4e-0023-445d-bbee-336e39407e8c","Type":"ContainerStarted","Data":"c75f3e87659cef5e977794814bfa71ff9899edbe208ea5580e27cdbfbc7547a5"} Jul 13 19:25:32.558770 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.558747 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" event={"ID":"0d88543b-1c99-46cd-bf80-e6fd0362389d","Type":"ContainerStarted","Data":"36580fc3e22e3fdcc983f8a720d671bdec080c2f06e25c9698824dffb72491f4"} Jul 13 19:25:32.560059 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.560037 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerStarted","Data":"97cd13ad5837e600952de0c365410f5aeca56748e64a52b7ff335c4bf7f0c909"} Jul 13 19:25:32.561204 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.561179 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kntpt" event={"ID":"82098306-9d22-4632-91bd-bc066d450d55","Type":"ContainerStarted","Data":"b32ddb78be46793668352438383c598f0264af40cf5edecfabfa97bd17d95e5c"} Jul 13 19:25:32.562559 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.562529 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vvrkv" event={"ID":"1f695c22-08df-468c-9050-dadead4b1556","Type":"ContainerStarted","Data":"ce3c787a744c2562e8779b6f8f7822f035c35c490d4ca76d6b608aa0e5914131"} Jul 13 19:25:32.563806 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.563785 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88hs" event={"ID":"be85543b-0c22-425e-bc2b-0d5784529e5d","Type":"ContainerStarted","Data":"8b9f69fc309e1c5be4398270cb0568f6397cf007422dc1652cbb0db098184def"} Jul 13 19:25:32.574618 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.574578 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" event={"ID":"154c5327aa16f9370b08bb6afc50c2f4","Type":"ContainerStarted","Data":"abfbbb607268c2ec0d5c0c832ae172a604d221f14061c8b49466b468170034f5"} Jul 13 19:25:32.575913 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.575892 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wg8bt" event={"ID":"f1c25a20-9a76-49e9-a5fe-b4ab031600d9","Type":"ContainerStarted","Data":"4665af8a2b8fcf543760a1149517cb6c1a2b197470bdace2e190557df5b10721"} Jul 13 19:25:32.591293 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.591244 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" podStartSLOduration=2.591228162 podStartE2EDuration="2.591228162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:32.590910496 +0000 UTC m=+3.637464794" watchObservedRunningTime="2026-07-13 19:25:32.591228162 +0000 UTC m=+3.637782436" Jul 13 19:25:32.997509 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:32.997413 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:32.997687 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:32.997588 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:32.997687 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:32.997663 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:34.997640175 +0000 UTC m=+6.044194444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:33.098726 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:33.098686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:33.098931 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:33.098745 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:33.098931 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:33.098923 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:33.099042 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:33.098992 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret podName:7f88c638-9d92-4e40-aa7f-620014bb4134 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:35.098972429 +0000 UTC m=+6.145526682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret") pod "global-pull-secret-syncer-mc8s4" (UID: "7f88c638-9d92-4e40-aa7f-620014bb4134") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:33.099152 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:33.099110 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:25:33.099152 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:33.099130 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:25:33.099152 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:33.099144 2555 projected.go:196] Error preparing data for projected volume kube-api-access-p5fsp for pod openshift-network-diagnostics/network-check-target-dfsp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:33.099296 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:33.099190 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp podName:1b04d793-b0c3-438f-a62a-4a297bea54bc nodeName:}" failed. No retries permitted until 2026-07-13 19:25:35.099176603 +0000 UTC m=+6.145730858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5fsp" (UniqueName: "kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp") pod "network-check-target-dfsp6" (UID: "1b04d793-b0c3-438f-a62a-4a297bea54bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:33.414205 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:33.414072 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 19:20:31 +0000 UTC" deadline="2028-02-18 10:15:33.701632989 +0000 UTC" Jul 13 19:25:33.414205 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:33.414140 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14030h50m0.28749768s" Jul 13 19:25:33.544367 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:33.544332 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:33.544601 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:33.544488 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:33.547391 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:33.547366 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:33.547538 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:33.547492 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:34.544352 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:34.544314 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:34.544963 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:34.544459 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:35.015829 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:35.015747 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:35.016016 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.015894 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:35.016016 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.015988 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:39.01595312 +0000 UTC m=+10.062507382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:35.116562 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:35.116518 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:35.116739 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:35.116568 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:35.116739 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.116687 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:35.116845 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.116744 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret podName:7f88c638-9d92-4e40-aa7f-620014bb4134 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:39.116726426 +0000 UTC m=+10.163280680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret") pod "global-pull-secret-syncer-mc8s4" (UID: "7f88c638-9d92-4e40-aa7f-620014bb4134") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:35.117205 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.117168 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:25:35.117205 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.117193 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:25:35.117205 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.117207 2555 projected.go:196] Error preparing data for projected volume kube-api-access-p5fsp for pod openshift-network-diagnostics/network-check-target-dfsp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:35.117392 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.117255 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp podName:1b04d793-b0c3-438f-a62a-4a297bea54bc nodeName:}" failed. No retries permitted until 2026-07-13 19:25:39.117238777 +0000 UTC m=+10.163793030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5fsp" (UniqueName: "kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp") pod "network-check-target-dfsp6" (UID: "1b04d793-b0c3-438f-a62a-4a297bea54bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:35.547672 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:35.547605 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:35.548153 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.547735 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:35.548153 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:35.547794 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:35.548153 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:35.547861 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:36.544351 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:36.543899 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:36.544351 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:36.544054 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:37.544571 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:37.544489 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:37.545043 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:37.544618 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:37.545110 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:37.545051 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:37.545171 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:37.545150 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:38.544054 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:38.544022 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:38.544197 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:38.544175 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:39.054311 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:39.053785 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:39.054311 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.053889 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:39.054311 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.053964 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:47.053944513 +0000 UTC m=+18.100498764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:39.155687 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:39.154898 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:39.155687 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:39.154950 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:39.155687 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.155095 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:39.155687 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.155158 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret podName:7f88c638-9d92-4e40-aa7f-620014bb4134 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:47.155139968 +0000 UTC m=+18.201694218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret") pod "global-pull-secret-syncer-mc8s4" (UID: "7f88c638-9d92-4e40-aa7f-620014bb4134") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:39.155687 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.155571 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:25:39.155687 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.155589 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:25:39.155687 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.155603 2555 projected.go:196] Error preparing data for projected volume kube-api-access-p5fsp for pod openshift-network-diagnostics/network-check-target-dfsp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:39.155687 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.155650 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp podName:1b04d793-b0c3-438f-a62a-4a297bea54bc nodeName:}" failed. No retries permitted until 2026-07-13 19:25:47.155635803 +0000 UTC m=+18.202190056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5fsp" (UniqueName: "kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp") pod "network-check-target-dfsp6" (UID: "1b04d793-b0c3-438f-a62a-4a297bea54bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:39.544842 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:39.544768 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:39.545028 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:39.544768 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:39.545028 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.544902 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:39.545028 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:39.544999 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:40.544366 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:40.544332 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:40.544822 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:40.544479 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:41.546315 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:41.546284 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:41.546702 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:41.546409 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:41.547314 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:41.547287 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:41.547443 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:41.547419 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:42.544273 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:42.544242 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:42.544434 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:42.544371 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:43.544706 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:43.544656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:43.545162 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:43.544797 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:43.545162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:43.544857 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:43.545162 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:43.545000 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:44.544001 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:44.543958 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:44.544188 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:44.544087 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:45.544123 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:45.544087 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:45.544563 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:45.544087 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:45.544563 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:45.544234 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:45.544563 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:45.544314 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:46.544065 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:46.544028 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:46.544278 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:46.544173 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:47.113023 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:47.112972 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:47.113180 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.113107 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:47.113233 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.113179 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:03.113163304 +0000 UTC m=+34.159717551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:25:47.214124 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:47.214078 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:47.214124 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:47.214130 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:47.214330 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.214269 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:25:47.214330 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.214282 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:47.214330 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.214291 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:25:47.214330 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.214300 2555 projected.go:196] Error preparing data for projected volume kube-api-access-p5fsp for pod openshift-network-diagnostics/network-check-target-dfsp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:47.214451 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.214347 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret podName:7f88c638-9d92-4e40-aa7f-620014bb4134 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:03.214329064 +0000 UTC m=+34.260883313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret") pod "global-pull-secret-syncer-mc8s4" (UID: "7f88c638-9d92-4e40-aa7f-620014bb4134") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:25:47.214451 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.214368 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp podName:1b04d793-b0c3-438f-a62a-4a297bea54bc nodeName:}" failed. No retries permitted until 2026-07-13 19:26:03.214356804 +0000 UTC m=+34.260911059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5fsp" (UniqueName: "kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp") pod "network-check-target-dfsp6" (UID: "1b04d793-b0c3-438f-a62a-4a297bea54bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:25:47.543743 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:47.543702 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:47.543743 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:47.543722 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:47.543951 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.543834 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:47.544030 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:47.543967 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:48.544136 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:48.544102 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:48.544548 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:48.544247 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:49.544610 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:49.544572 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:49.545092 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:49.544680 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:49.545092 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:49.544714 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:49.545092 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:49.544813 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:50.544140 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:50.544109 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:50.544336 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:50.544247 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:51.544227 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:51.544180 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:51.544675 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:51.544194 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:51.544675 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:51.544340 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:51.544675 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:51.544392 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:52.544622 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.544324 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:52.545230 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:52.544698 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:52.616192 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.616166 2555 generic.go:356] "Generic (PLEG): container finished" podID="c79db9e0088f021416e97154f40eb7a5" containerID="205814b8c3fbb5cd1ef82889a019b2b186f7498b95c95b0599bd84e4769bb007" exitCode=0 Jul 13 19:25:52.616305 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.616248 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" event={"ID":"c79db9e0088f021416e97154f40eb7a5","Type":"ContainerDied","Data":"205814b8c3fbb5cd1ef82889a019b2b186f7498b95c95b0599bd84e4769bb007"} Jul 13 19:25:52.621808 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.621780 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m9wqk" event={"ID":"75d81a4e-0023-445d-bbee-336e39407e8c","Type":"ContainerStarted","Data":"1999126bc28fa032c7453be7cfc9e72d9363bae60d81d483063ead63785e5448"} Jul 13 19:25:52.623372 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.623347 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" event={"ID":"0d88543b-1c99-46cd-bf80-e6fd0362389d","Type":"ContainerStarted","Data":"4d5ddf8bdfa8c7df15e0dee3170abeb1aea5419d6641277632aa14806731b0d4"} Jul 13 19:25:52.626001 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.625941 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:25:52.626330 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.626306 2555 generic.go:356] "Generic (PLEG): container finished" podID="35273a9e-cd1d-45ff-974f-1111d3941390" containerID="6af19012b43bc204f6c0bdbeca0cc6d1b0035e314d12e0df676fc4d63519ae7d" exitCode=1 Jul 13 19:25:52.626420 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.626379 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerStarted","Data":"3b1761a7f6ebf4773ecff30e3cedbcf72bd26eca868eac0a47ac0fef777a570c"} Jul 13 19:25:52.626481 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.626429 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerStarted","Data":"8d2416c9d31c5c05a5fec6f182b7b6c66cf4508fb592adebd30b63a76c579836"} Jul 13 19:25:52.626481 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.626459 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerStarted","Data":"31d745eb1203d7eeb1671c498fd7c73790924a172bb1a0c5df80faa23423cf72"} Jul 13 19:25:52.626586 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.626487 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerDied","Data":"6af19012b43bc204f6c0bdbeca0cc6d1b0035e314d12e0df676fc4d63519ae7d"} Jul 13 19:25:52.626586 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.626515 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerStarted","Data":"f123efa4a55e8f770e4adf530d274f26a8d6eed2d224ce17e0dcc5aeb824b5c7"} Jul 13 19:25:52.627930 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.627903 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kntpt" event={"ID":"82098306-9d22-4632-91bd-bc066d450d55","Type":"ContainerStarted","Data":"ccb92b51634b00845c689e737525fb619d332ad53ff62bc63d4c58538840bdf1"} Jul 13 19:25:52.629529 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.629509 2555 generic.go:356] "Generic (PLEG): container finished" podID="be85543b-0c22-425e-bc2b-0d5784529e5d" containerID="ad64f5d56414dd9b47ad1582dd9436bdc7efe9759a8cca1d10553a11b87f2b4b" exitCode=0 Jul 13 19:25:52.629637 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.629537 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88hs" event={"ID":"be85543b-0c22-425e-bc2b-0d5784529e5d","Type":"ContainerDied","Data":"ad64f5d56414dd9b47ad1582dd9436bdc7efe9759a8cca1d10553a11b87f2b4b"} Jul 13 19:25:52.631296 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.631221 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wg8bt" event={"ID":"f1c25a20-9a76-49e9-a5fe-b4ab031600d9","Type":"ContainerStarted","Data":"dd7fdea85a028f18c883a8e74e01c5830ada5c9501b8a54a9f3ba543222c7a00"} Jul 13 19:25:52.633473 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.633450 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t877d" event={"ID":"3a880dc9-d62a-455d-a46b-09e03d167960","Type":"ContainerStarted","Data":"0e6b95ee86afbd46c4ee486a020be873957804768e131e52732cb2405cea3841"} Jul 13 19:25:52.635297 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.635261 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-498ml" event={"ID":"04f68363-e7c2-4de9-bbb8-969765564cfb","Type":"ContainerStarted","Data":"a0eb20060be9142140595ead9d182d23381ae9f61127ede9e488ba1abba917c1"} Jul 13 19:25:52.637560 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.637514 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m9wqk" podStartSLOduration=4.335497146 podStartE2EDuration="23.637502254s" totalImagesPullingTime="19.302005108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:52.636741088 +0000 UTC m=+23.683295360" watchObservedRunningTime="2026-07-13 19:25:52.637502254 +0000 UTC m=+23.684056545" Jul 13 19:25:52.679294 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.679248 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kntpt" podStartSLOduration=8.922288637 podStartE2EDuration="23.679228986s" totalImagesPullingTime="14.756940349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:52.678869762 +0000 UTC m=+23.725424051" watchObservedRunningTime="2026-07-13 19:25:52.679228986 +0000 UTC m=+23.725783256" Jul 13 19:25:52.695960 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.695909 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t877d" podStartSLOduration=4.387599002 podStartE2EDuration="23.695880481s" totalImagesPullingTime="19.308281479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:52.695341498 +0000 UTC m=+23.741895788" watchObservedRunningTime="2026-07-13 19:25:52.695880481 +0000 UTC m=+23.742434753" Jul 13 19:25:52.715876 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.715776 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wg8bt" podStartSLOduration=4.395598473 podStartE2EDuration="23.715753675s" totalImagesPullingTime="19.320155202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:52.715252083 +0000 UTC m=+23.761806372" watchObservedRunningTime="2026-07-13 19:25:52.715753675 +0000 UTC m=+23.762307949" Jul 13 19:25:52.727701 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.727672 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:25:52.732851 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.732811 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-498ml" podStartSLOduration=4.400177235 podStartE2EDuration="23.732797119s" totalImagesPullingTime="19.332619884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:52.732478281 +0000 UTC m=+23.779032569" watchObservedRunningTime="2026-07-13 19:25:52.732797119 +0000 UTC m=+23.779351388" Jul 13 19:25:52.838356 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.838323 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:25:52.913443 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:52.913391 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:25:53.464818 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.464794 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 19:25:53.543995 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.543949 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:53.544168 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:53.544111 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:53.544264 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.544162 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:53.544326 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:53.544256 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:53.639734 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.639618 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" event={"ID":"0d88543b-1c99-46cd-bf80-e6fd0362389d","Type":"ContainerStarted","Data":"603daedc9c326d3695a23f94877f7ed7d1b489ff79fff99529955d6c90daefe2"} Jul 13 19:25:53.642831 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.642811 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:25:53.643338 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.643310 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerStarted","Data":"9c486d700abc479ab5b469008f7c1c726621fe9efdcd88e61b366294a151aceb"} Jul 13 19:25:53.645012 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.644952 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vvrkv" event={"ID":"1f695c22-08df-468c-9050-dadead4b1556","Type":"ContainerStarted","Data":"81b6a7ac2009e519a6c0c793ffd0209d7ca2d92b6ab1402e452bcf3221038488"} Jul 13 19:25:53.660581 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.660535 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vvrkv" podStartSLOduration=5.369373243 podStartE2EDuration="24.660520711s" totalImagesPullingTime="19.291147468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:53.660269785 +0000 UTC m=+24.706824055" watchObservedRunningTime="2026-07-13 19:25:53.660520711 +0000 UTC m=+24.707074980" Jul 13 19:25:53.780368 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.780321 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:25:53.882168 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:53.882138 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:25:54.439844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.439740 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T19:25:53.464812159Z","UUID":"9eb6d40f-f90e-490a-ad07-d60bf2149f11","Handler":null,"Name":"","Endpoint":""} Jul 13 19:25:54.441702 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.441680 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 19:25:54.441853 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.441754 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 19:25:54.544398 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.544367 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:54.544622 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:54.544504 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:54.649750 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.649716 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" event={"ID":"c79db9e0088f021416e97154f40eb7a5","Type":"ContainerStarted","Data":"9249b3e4a1bd80360d98e7a7d0688087b43e5e62ef9efa179cbe6f68e7fbda1a"} Jul 13 19:25:54.667454 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.667397 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" podStartSLOduration=24.667375131 podStartE2EDuration="24.667375131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:54.666546474 +0000 UTC m=+25.713100765" watchObservedRunningTime="2026-07-13 19:25:54.667375131 +0000 UTC m=+25.713929406" Jul 13 19:25:54.724486 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.724462 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:54.725232 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.725162 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:54.725436 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.725410 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:54.725791 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.725763 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kntpt" Jul 13 19:25:54.879313 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:54.879273 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:25:55.544269 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:55.544033 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:55.544571 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:55.544367 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:55.544726 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:55.544065 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:55.544840 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:55.544814 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:55.654844 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:55.654805 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" event={"ID":"0d88543b-1c99-46cd-bf80-e6fd0362389d","Type":"ContainerStarted","Data":"e9f63506d0e29e02e546d7aabaed4d1a3ad4bae189d65df0dfea9963c6c82c04"} Jul 13 19:25:55.658373 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:55.658345 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:25:55.658809 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:55.658783 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerStarted","Data":"e63cde1bc4a1041a3865a2fc664321acc0817d3ad4beae1b1ec5b83d66b71da5"} Jul 13 19:25:55.676092 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:55.676028 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tqdtc" podStartSLOduration=4.967228562 podStartE2EDuration="26.676005899s" totalImagesPullingTime="21.708777337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:55.675334176 +0000 UTC m=+26.721888448" watchObservedRunningTime="2026-07-13 19:25:55.676005899 +0000 UTC m=+26.722560162" Jul 13 19:25:56.544291 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:56.544251 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:56.544513 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:56.544387 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:57.544409 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.544134 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:57.544409 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.544168 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:57.545094 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:57.544429 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:57.545094 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:57.544483 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:57.666993 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.666961 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:25:57.667341 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.667314 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerStarted","Data":"a694e786d647abe5db31a78b0466f030defb5b001490221d20371534c89c3601"} Jul 13 19:25:57.667573 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.667544 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:57.667656 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.667626 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:57.667749 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.667732 2555 scope.go:117] "RemoveContainer" containerID="6af19012b43bc204f6c0bdbeca0cc6d1b0035e314d12e0df676fc4d63519ae7d" Jul 13 19:25:57.669317 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.669292 2555 generic.go:356] "Generic (PLEG): container finished" podID="be85543b-0c22-425e-bc2b-0d5784529e5d" containerID="93a4b32124cd9d92fe9925c831e7da1b392292af94fa73196dfdd57eda1650de" exitCode=0 Jul 13 19:25:57.669407 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.669327 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88hs" event={"ID":"be85543b-0c22-425e-bc2b-0d5784529e5d","Type":"ContainerDied","Data":"93a4b32124cd9d92fe9925c831e7da1b392292af94fa73196dfdd57eda1650de"} Jul 13 19:25:57.686283 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:57.686261 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:58.140890 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:58.140850 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:25:58.544376 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:58.544307 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:58.544500 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:58.544415 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:58.676403 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:58.676374 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:25:58.676808 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:58.676769 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" event={"ID":"35273a9e-cd1d-45ff-974f-1111d3941390","Type":"ContainerStarted","Data":"1d9ba903f8d9cb66a36e2b80e833bf9ffad40227697caad1165d1cd2b6eaf4db"} Jul 13 19:25:58.677165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:58.677140 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:58.696742 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:58.696721 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:25:58.705289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:58.705246 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" podStartSLOduration=10.073761126 podStartE2EDuration="29.70523237s" totalImagesPullingTime="19.631471244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:58.705140756 +0000 UTC m=+29.751695048" watchObservedRunningTime="2026-07-13 19:25:58.70523237 +0000 UTC m=+29.751786642" Jul 13 19:25:59.281301 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:59.281264 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dfsp6"] Jul 13 19:25:59.281436 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:59.281393 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:25:59.281545 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:59.281523 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:25:59.282045 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:59.282026 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mc8s4"] Jul 13 19:25:59.282135 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:59.282122 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:25:59.282236 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:59.282218 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:25:59.283083 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:59.283060 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm67z"] Jul 13 19:25:59.283179 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:59.283150 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:25:59.283245 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:25:59.283229 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:25:59.681011 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:59.680804 2555 generic.go:356] "Generic (PLEG): container finished" podID="be85543b-0c22-425e-bc2b-0d5784529e5d" containerID="168e63c64ab6615ca4ef930c92c73793e30abbf8ddbca8dbb0a09f793dcdb772" exitCode=0 Jul 13 19:25:59.681413 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:25:59.680888 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88hs" event={"ID":"be85543b-0c22-425e-bc2b-0d5784529e5d","Type":"ContainerDied","Data":"168e63c64ab6615ca4ef930c92c73793e30abbf8ddbca8dbb0a09f793dcdb772"} Jul 13 19:26:00.543837 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:00.543797 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:26:00.543837 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:00.543830 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:26:00.544075 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:00.543935 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:26:00.544075 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:00.544065 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:26:01.544289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:01.544205 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:26:01.544706 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:01.544322 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:26:01.689386 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:01.689340 2555 generic.go:356] "Generic (PLEG): container finished" podID="be85543b-0c22-425e-bc2b-0d5784529e5d" containerID="51e05ec61063cf792f48b3e1f9e1c04ad5c084c03252259f84baee581b557973" exitCode=0 Jul 13 19:26:01.689523 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:01.689418 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88hs" event={"ID":"be85543b-0c22-425e-bc2b-0d5784529e5d","Type":"ContainerDied","Data":"51e05ec61063cf792f48b3e1f9e1c04ad5c084c03252259f84baee581b557973"} Jul 13 19:26:02.544236 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:02.544196 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:26:02.544408 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:02.544201 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:26:02.544408 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:02.544320 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:26:02.544883 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:02.544411 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:26:03.018037 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:03.017999 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:03.073198 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:03.073162 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:03.138333 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:03.138290 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:26:03.138504 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:03.138461 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:26:03.138566 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:03.138536 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:35.138513676 +0000 UTC m=+66.185067928 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 19:26:03.238885 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:03.238850 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:26:03.238885 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:03.238889 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:26:03.239150 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:03.239011 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 19:26:03.239150 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:03.239042 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 19:26:03.239150 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:03.239069 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret podName:7f88c638-9d92-4e40-aa7f-620014bb4134 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:35.239052054 +0000 UTC m=+66.285606304 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret") pod "global-pull-secret-syncer-mc8s4" (UID: "7f88c638-9d92-4e40-aa7f-620014bb4134") : object "kube-system"/"original-pull-secret" not registered Jul 13 19:26:03.239150 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:03.239070 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 19:26:03.239150 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:03.239083 2555 projected.go:196] Error preparing data for projected volume kube-api-access-p5fsp for pod openshift-network-diagnostics/network-check-target-dfsp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:26:03.239150 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:03.239134 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp podName:1b04d793-b0c3-438f-a62a-4a297bea54bc nodeName:}" failed. No retries permitted until 2026-07-13 19:26:35.239116333 +0000 UTC m=+66.285670583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p5fsp" (UniqueName: "kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp") pod "network-check-target-dfsp6" (UID: "1b04d793-b0c3-438f-a62a-4a297bea54bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 19:26:03.544268 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:03.544236 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:26:03.544408 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:03.544350 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:26:04.544204 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:04.544164 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:26:04.544672 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:04.544209 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:26:04.544672 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:04.544276 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dfsp6" podUID="1b04d793-b0c3-438f-a62a-4a297bea54bc" Jul 13 19:26:04.544672 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:04.544409 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mc8s4" podUID="7f88c638-9d92-4e40-aa7f-620014bb4134" Jul 13 19:26:05.544605 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.544532 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:26:05.545063 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:05.544653 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:26:05.735838 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.735803 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeReady" Jul 13 19:26:05.736087 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.736020 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 19:26:05.780719 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.780689 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h8rl5"] Jul 13 19:26:05.782537 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.782519 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.785098 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.785075 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 19:26:05.785233 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.785218 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nf5fn\"" Jul 13 19:26:05.785294 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.785281 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 19:26:05.788031 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.788010 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kg5n4"] Jul 13 19:26:05.789638 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.789615 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kg5n4" Jul 13 19:26:05.792124 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.792104 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 19:26:05.792414 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.792398 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 19:26:05.792826 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.792810 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 19:26:05.794489 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.794448 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8rl5"] Jul 13 19:26:05.795386 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.795185 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9jjnz\"" Jul 13 19:26:05.801677 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.801652 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kg5n4"] Jul 13 19:26:05.860162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.860130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmd7k\" (UniqueName: \"kubernetes.io/projected/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-kube-api-access-rmd7k\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.860316 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.860190 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-config-volume\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.860316 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.860259 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.860421 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.860334 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-tmp-dir\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.917746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.917696 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:05.960802 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.960769 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-config-volume\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.961003 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.960814 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.961003 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.960914 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b613bdc-4461-47c2-b357-b14b9aa599d4-cert\") pod \"ingress-canary-kg5n4\" (UID: \"4b613bdc-4461-47c2-b357-b14b9aa599d4\") " pod="openshift-ingress-canary/ingress-canary-kg5n4" Jul 13 19:26:05.961003 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:05.960944 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:26:05.961003 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.960963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcbw5\" (UniqueName: \"kubernetes.io/projected/4b613bdc-4461-47c2-b357-b14b9aa599d4-kube-api-access-bcbw5\") pod \"ingress-canary-kg5n4\" (UID: \"4b613bdc-4461-47c2-b357-b14b9aa599d4\") " pod="openshift-ingress-canary/ingress-canary-kg5n4" Jul 13 19:26:05.961197 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:05.961021 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls podName:2bb1bdb8-3bab-44cd-a3fc-074213c9cd34 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:06.461003169 +0000 UTC m=+37.507557424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls") pod "dns-default-h8rl5" (UID: "2bb1bdb8-3bab-44cd-a3fc-074213c9cd34") : secret "dns-default-metrics-tls" not found Jul 13 19:26:05.961197 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.961041 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-tmp-dir\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.961197 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.961086 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmd7k\" (UniqueName: \"kubernetes.io/projected/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-kube-api-access-rmd7k\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.961387 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.961365 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-tmp-dir\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.961513 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.961493 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-config-volume\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:05.973756 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:05.973624 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmd7k\" (UniqueName: \"kubernetes.io/projected/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-kube-api-access-rmd7k\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:06.026241 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.026195 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:06.062316 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.062165 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b613bdc-4461-47c2-b357-b14b9aa599d4-cert\") pod \"ingress-canary-kg5n4\" (UID: \"4b613bdc-4461-47c2-b357-b14b9aa599d4\") " pod="openshift-ingress-canary/ingress-canary-kg5n4" Jul 13 19:26:06.062316 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.062229 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcbw5\" (UniqueName: \"kubernetes.io/projected/4b613bdc-4461-47c2-b357-b14b9aa599d4-kube-api-access-bcbw5\") pod \"ingress-canary-kg5n4\" (UID: \"4b613bdc-4461-47c2-b357-b14b9aa599d4\") " pod="openshift-ingress-canary/ingress-canary-kg5n4" Jul 13 19:26:06.064827 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.064809 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b613bdc-4461-47c2-b357-b14b9aa599d4-cert\") pod \"ingress-canary-kg5n4\" (UID: \"4b613bdc-4461-47c2-b357-b14b9aa599d4\") " pod="openshift-ingress-canary/ingress-canary-kg5n4" Jul 13 19:26:06.070957 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.070932 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcbw5\" (UniqueName: \"kubernetes.io/projected/4b613bdc-4461-47c2-b357-b14b9aa599d4-kube-api-access-bcbw5\") pod \"ingress-canary-kg5n4\" (UID: \"4b613bdc-4461-47c2-b357-b14b9aa599d4\") " pod="openshift-ingress-canary/ingress-canary-kg5n4" Jul 13 19:26:06.101117 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.101075 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kg5n4" Jul 13 19:26:06.234667 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.234639 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kg5n4"] Jul 13 19:26:06.238703 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:26:06.238673 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b613bdc_4461_47c2_b357_b14b9aa599d4.slice/crio-85a411ec89cb803e323ccb0eec8eb519fb7fda808dbebfa301c1d2afc17ca243 WatchSource:0}: Error finding container 85a411ec89cb803e323ccb0eec8eb519fb7fda808dbebfa301c1d2afc17ca243: Status 404 returned error can't find the container with id 85a411ec89cb803e323ccb0eec8eb519fb7fda808dbebfa301c1d2afc17ca243 Jul 13 19:26:06.465413 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.465326 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:06.465559 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:06.465453 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:26:06.465559 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:06.465504 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls podName:2bb1bdb8-3bab-44cd-a3fc-074213c9cd34 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:07.465490592 +0000 UTC m=+38.512044841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls") pod "dns-default-h8rl5" (UID: "2bb1bdb8-3bab-44cd-a3fc-074213c9cd34") : secret "dns-default-metrics-tls" not found Jul 13 19:26:06.544359 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.544322 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:26:06.544494 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.544322 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:26:06.547604 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.547585 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 19:26:06.547935 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.547585 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n645d\"" Jul 13 19:26:06.547935 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.547635 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 19:26:06.547935 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.547604 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 19:26:06.705106 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.705066 2555 generic.go:356] "Generic (PLEG): container finished" podID="be85543b-0c22-425e-bc2b-0d5784529e5d" containerID="15038c775525cea76d42a045566b6939f0802d106533d2b1e68b5af5971e888c" exitCode=0 Jul 13 19:26:06.705276 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.705156 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88hs" event={"ID":"be85543b-0c22-425e-bc2b-0d5784529e5d","Type":"ContainerDied","Data":"15038c775525cea76d42a045566b6939f0802d106533d2b1e68b5af5971e888c"} Jul 13 19:26:06.706253 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:06.706235 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kg5n4" event={"ID":"4b613bdc-4461-47c2-b357-b14b9aa599d4","Type":"ContainerStarted","Data":"85a411ec89cb803e323ccb0eec8eb519fb7fda808dbebfa301c1d2afc17ca243"} Jul 13 19:26:07.474033 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:07.473994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:07.474199 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:07.474160 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:26:07.474254 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:07.474240 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls podName:2bb1bdb8-3bab-44cd-a3fc-074213c9cd34 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:09.474215673 +0000 UTC m=+40.520769941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls") pod "dns-default-h8rl5" (UID: "2bb1bdb8-3bab-44cd-a3fc-074213c9cd34") : secret "dns-default-metrics-tls" not found Jul 13 19:26:07.543717 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:07.543684 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:26:07.546600 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:07.546570 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 19:26:07.546883 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:07.546864 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzrsk\"" Jul 13 19:26:07.714299 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:07.714262 2555 generic.go:356] "Generic (PLEG): container finished" podID="be85543b-0c22-425e-bc2b-0d5784529e5d" containerID="908d001ede49c2eab2c0a83a0ad21c507231ba2f50378e6ec2c3837e39dc227c" exitCode=0 Jul 13 19:26:07.714747 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:07.714317 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88hs" event={"ID":"be85543b-0c22-425e-bc2b-0d5784529e5d","Type":"ContainerDied","Data":"908d001ede49c2eab2c0a83a0ad21c507231ba2f50378e6ec2c3837e39dc227c"} Jul 13 19:26:08.105972 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:08.105768 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:08.170727 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:08.170696 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:08.719556 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:08.719523 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88hs" event={"ID":"be85543b-0c22-425e-bc2b-0d5784529e5d","Type":"ContainerStarted","Data":"8bb48b90aa62aaab778f6164021a5033369b4cabe8d1810ca913b73e917eeb20"} Jul 13 19:26:08.744242 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:08.744171 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t88hs" podStartSLOduration=9.398387828 podStartE2EDuration="39.744155343s" totalImagesPullingTime="30.345767515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:08.742506076 +0000 UTC m=+39.789060365" watchObservedRunningTime="2026-07-13 19:26:08.744155343 +0000 UTC m=+39.790709614" Jul 13 19:26:08.867299 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:08.867200 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:08.964136 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:08.964100 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:09.064955 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:09.064924 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:09.490470 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:09.490440 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:09.490637 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:09.490562 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:26:09.490637 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:09.490611 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls podName:2bb1bdb8-3bab-44cd-a3fc-074213c9cd34 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:13.490597932 +0000 UTC m=+44.537152180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls") pod "dns-default-h8rl5" (UID: "2bb1bdb8-3bab-44cd-a3fc-074213c9cd34") : secret "dns-default-metrics-tls" not found Jul 13 19:26:09.723082 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:09.723045 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kg5n4" event={"ID":"4b613bdc-4461-47c2-b357-b14b9aa599d4","Type":"ContainerStarted","Data":"34624146783be6e34740849d0112206341921150926c37ef4836d6d1a9b9069d"} Jul 13 19:26:09.740208 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:09.740162 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kg5n4" podStartSLOduration=2.050371385 podStartE2EDuration="4.740145746s" totalImagesPullingTime="2.689774361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:09.73853439 +0000 UTC m=+40.785088689" watchObservedRunningTime="2026-07-13 19:26:09.740145746 +0000 UTC m=+40.786700016" Jul 13 19:26:11.320996 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:11.320947 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:11.381764 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:11.381732 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:13.520076 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:13.520030 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:13.520427 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:13.520176 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:26:13.520427 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:13.520236 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls podName:2bb1bdb8-3bab-44cd-a3fc-074213c9cd34 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:21.520219404 +0000 UTC m=+52.566773673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls") pod "dns-default-h8rl5" (UID: "2bb1bdb8-3bab-44cd-a3fc-074213c9cd34") : secret "dns-default-metrics-tls" not found Jul 13 19:26:21.578430 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:21.578400 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:21.579117 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:21.578535 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:26:21.579117 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:21.578599 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls podName:2bb1bdb8-3bab-44cd-a3fc-074213c9cd34 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:37.578584836 +0000 UTC m=+68.625139084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls") pod "dns-default-h8rl5" (UID: "2bb1bdb8-3bab-44cd-a3fc-074213c9cd34") : secret "dns-default-metrics-tls" not found Jul 13 19:26:28.892720 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:28.892683 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:28.991805 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:28.991750 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:30.702630 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:30.702602 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hmw6r" Jul 13 19:26:30.821926 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:30.821894 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:30.919435 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:30.919377 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:26:35.168662 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.168617 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:26:35.171830 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.171809 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 19:26:35.179383 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:35.179353 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 13 19:26:35.179466 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:35.179436 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:27:39.179420466 +0000 UTC m=+130.225974716 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : secret "metrics-daemon-secret" not found Jul 13 19:26:35.269371 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.269344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:26:35.269464 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.269376 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:26:35.272178 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.272159 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 19:26:35.272261 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.272223 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 19:26:35.282595 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.282574 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 19:26:35.283859 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.283843 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f88c638-9d92-4e40-aa7f-620014bb4134-original-pull-secret\") pod \"global-pull-secret-syncer-mc8s4\" (UID: \"7f88c638-9d92-4e40-aa7f-620014bb4134\") " pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:26:35.292750 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.292729 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5fsp\" (UniqueName: \"kubernetes.io/projected/1b04d793-b0c3-438f-a62a-4a297bea54bc-kube-api-access-p5fsp\") pod \"network-check-target-dfsp6\" (UID: \"1b04d793-b0c3-438f-a62a-4a297bea54bc\") " pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:26:35.353547 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.353512 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mc8s4" Jul 13 19:26:35.361272 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.361246 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n645d\"" Jul 13 19:26:35.368784 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.368762 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:26:35.491703 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.489616 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mc8s4"] Jul 13 19:26:35.501090 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.501064 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dfsp6"] Jul 13 19:26:35.504148 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:26:35.504127 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b04d793_b0c3_438f_a62a_4a297bea54bc.slice/crio-4a6978fcfb8502eb5e53ba21d40d3ca874c4bf99d268738ff6e230a2ee2c7fbd WatchSource:0}: Error finding container 4a6978fcfb8502eb5e53ba21d40d3ca874c4bf99d268738ff6e230a2ee2c7fbd: Status 404 returned error can't find the container with id 4a6978fcfb8502eb5e53ba21d40d3ca874c4bf99d268738ff6e230a2ee2c7fbd Jul 13 19:26:35.781260 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.781160 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mc8s4" event={"ID":"7f88c638-9d92-4e40-aa7f-620014bb4134","Type":"ContainerStarted","Data":"fae948f0c9a7a7a648c9ea7810172ed919afe778fb6536b420d99a5dcd5035ec"} Jul 13 19:26:35.782122 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:35.782102 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dfsp6" event={"ID":"1b04d793-b0c3-438f-a62a-4a297bea54bc","Type":"ContainerStarted","Data":"4a6978fcfb8502eb5e53ba21d40d3ca874c4bf99d268738ff6e230a2ee2c7fbd"} Jul 13 19:26:37.585105 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:37.585071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:26:37.585580 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:37.585249 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:26:37.585580 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:26:37.585366 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls podName:2bb1bdb8-3bab-44cd-a3fc-074213c9cd34 nodeName:}" failed. No retries permitted until 2026-07-13 19:27:09.58534354 +0000 UTC m=+100.631897791 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls") pod "dns-default-h8rl5" (UID: "2bb1bdb8-3bab-44cd-a3fc-074213c9cd34") : secret "dns-default-metrics-tls" not found Jul 13 19:26:40.797453 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:40.797419 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dfsp6" event={"ID":"1b04d793-b0c3-438f-a62a-4a297bea54bc","Type":"ContainerStarted","Data":"6789d76a6a2abff030153215f43b271c6fd486b1ed4e0b5eae281fe3619f4f79"} Jul 13 19:26:40.797879 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:40.797543 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:26:40.799021 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:40.798998 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mc8s4" event={"ID":"7f88c638-9d92-4e40-aa7f-620014bb4134","Type":"ContainerStarted","Data":"fada1af26d6340a9c6af7655fb3b06b93a8819149e5a170bb9d410f3eee5e524"} Jul 13 19:26:40.812764 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:40.812717 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dfsp6" podStartSLOduration=66.92700396 podStartE2EDuration="1m11.812701575s" totalImagesPullingTime="4.885697615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:40.812351127 +0000 UTC m=+71.858905412" watchObservedRunningTime="2026-07-13 19:26:40.812701575 +0000 UTC m=+71.859255846" Jul 13 19:26:40.825826 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:40.825790 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mc8s4" podStartSLOduration=66.925533755 podStartE2EDuration="1m11.825776267s" totalImagesPullingTime="4.900242512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:40.82555336 +0000 UTC m=+71.872107657" watchObservedRunningTime="2026-07-13 19:26:40.825776267 +0000 UTC m=+71.872330538" Jul 13 19:26:43.939047 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.939014 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9"] Jul 13 19:26:43.940813 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.940798 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" Jul 13 19:26:43.942481 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.942462 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs"] Jul 13 19:26:43.944111 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.944094 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:43.944719 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.944689 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m52ft\"" Jul 13 19:26:43.944823 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.944689 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 19:26:43.944823 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.944689 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 13 19:26:43.944823 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.944693 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 19:26:43.944999 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.944689 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 19:26:43.946543 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.946520 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 13 19:26:43.946632 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.946562 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 13 19:26:43.946632 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.946520 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 13 19:26:43.946872 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.946855 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 13 19:26:43.953747 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.953726 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9"] Jul 13 19:26:43.956905 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:43.956886 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs"] Jul 13 19:26:44.027527 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.027502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb498eb9-ed79-4fd6-908c-7acefa921dc4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9\" (UID: \"fb498eb9-ed79-4fd6-908c-7acefa921dc4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" Jul 13 19:26:44.027681 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.027531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khppx\" (UniqueName: \"kubernetes.io/projected/fb498eb9-ed79-4fd6-908c-7acefa921dc4-kube-api-access-khppx\") pod \"managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9\" (UID: \"fb498eb9-ed79-4fd6-908c-7acefa921dc4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" Jul 13 19:26:44.027681 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.027548 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.027681 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.027658 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-ca\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.027814 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.027681 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-hub\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.027814 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.027700 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.027814 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.027729 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a996a8cb-e178-47d2-bca4-023703af4dc7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.027814 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.027749 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt2tx\" (UniqueName: \"kubernetes.io/projected/a996a8cb-e178-47d2-bca4-023703af4dc7-kube-api-access-kt2tx\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.128090 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.128050 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-ca\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.128210 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.128095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-hub\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.128210 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.128121 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.128210 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.128149 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a996a8cb-e178-47d2-bca4-023703af4dc7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.128210 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.128172 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt2tx\" (UniqueName: \"kubernetes.io/projected/a996a8cb-e178-47d2-bca4-023703af4dc7-kube-api-access-kt2tx\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.128210 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.128205 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb498eb9-ed79-4fd6-908c-7acefa921dc4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9\" (UID: \"fb498eb9-ed79-4fd6-908c-7acefa921dc4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" Jul 13 19:26:44.128468 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.128229 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khppx\" (UniqueName: \"kubernetes.io/projected/fb498eb9-ed79-4fd6-908c-7acefa921dc4-kube-api-access-khppx\") pod \"managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9\" (UID: \"fb498eb9-ed79-4fd6-908c-7acefa921dc4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" Jul 13 19:26:44.128468 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.128404 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.129019 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.128917 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a996a8cb-e178-47d2-bca4-023703af4dc7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.130718 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.130691 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-ca\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.130809 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.130743 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.131267 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.131246 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.131308 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.131252 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a996a8cb-e178-47d2-bca4-023703af4dc7-hub\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.131341 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.131318 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fb498eb9-ed79-4fd6-908c-7acefa921dc4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9\" (UID: \"fb498eb9-ed79-4fd6-908c-7acefa921dc4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" Jul 13 19:26:44.136504 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.136484 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khppx\" (UniqueName: \"kubernetes.io/projected/fb498eb9-ed79-4fd6-908c-7acefa921dc4-kube-api-access-khppx\") pod \"managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9\" (UID: \"fb498eb9-ed79-4fd6-908c-7acefa921dc4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" Jul 13 19:26:44.136684 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.136656 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt2tx\" (UniqueName: \"kubernetes.io/projected/a996a8cb-e178-47d2-bca4-023703af4dc7-kube-api-access-kt2tx\") pod \"cluster-proxy-proxy-agent-cb66d49db-bq5xs\" (UID: \"a996a8cb-e178-47d2-bca4-023703af4dc7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.258730 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.258659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" Jul 13 19:26:44.263827 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.263799 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:26:44.394205 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.394177 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9"] Jul 13 19:26:44.397461 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:26:44.397439 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb498eb9_ed79_4fd6_908c_7acefa921dc4.slice/crio-2db81c4a04bff6caac1d16d5cc5715a0e714ed32638de8119d3ca18b0077cd7d WatchSource:0}: Error finding container 2db81c4a04bff6caac1d16d5cc5715a0e714ed32638de8119d3ca18b0077cd7d: Status 404 returned error can't find the container with id 2db81c4a04bff6caac1d16d5cc5715a0e714ed32638de8119d3ca18b0077cd7d Jul 13 19:26:44.411724 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.411702 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs"] Jul 13 19:26:44.414800 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:26:44.414774 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda996a8cb_e178_47d2_bca4_023703af4dc7.slice/crio-5cb33b762fdee704378a50808448e2f71e51191ad9fb10a5fd509fb8dd00c39e WatchSource:0}: Error finding container 5cb33b762fdee704378a50808448e2f71e51191ad9fb10a5fd509fb8dd00c39e: Status 404 returned error can't find the container with id 5cb33b762fdee704378a50808448e2f71e51191ad9fb10a5fd509fb8dd00c39e Jul 13 19:26:44.809227 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.809194 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" event={"ID":"a996a8cb-e178-47d2-bca4-023703af4dc7","Type":"ContainerStarted","Data":"5cb33b762fdee704378a50808448e2f71e51191ad9fb10a5fd509fb8dd00c39e"} Jul 13 19:26:44.810213 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:44.810187 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" event={"ID":"fb498eb9-ed79-4fd6-908c-7acefa921dc4","Type":"ContainerStarted","Data":"2db81c4a04bff6caac1d16d5cc5715a0e714ed32638de8119d3ca18b0077cd7d"} Jul 13 19:26:47.820454 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:47.820416 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" event={"ID":"fb498eb9-ed79-4fd6-908c-7acefa921dc4","Type":"ContainerStarted","Data":"6405f94366148744e6085972e99fc29bd89c148fd1f100fda95643f989324af4"} Jul 13 19:26:47.836959 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:47.836908 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" podStartSLOduration=1.8898466649999999 podStartE2EDuration="4.836892838s" totalImagesPullingTime="2.947046173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:47.836037708 +0000 UTC m=+78.882591979" watchObservedRunningTime="2026-07-13 19:26:47.836892838 +0000 UTC m=+78.883447108" Jul 13 19:26:48.825119 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:48.824999 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" event={"ID":"a996a8cb-e178-47d2-bca4-023703af4dc7","Type":"ContainerStarted","Data":"3bca249a9076a4bfe0e37f66d47d3fd45dfc454eea9275d701141623dad9666b"} Jul 13 19:26:49.829768 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:49.829630 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" event={"ID":"a996a8cb-e178-47d2-bca4-023703af4dc7","Type":"ContainerStarted","Data":"620359c9436690067ef597d87b027f2e2397cad511a6489968a227fa32483b85"} Jul 13 19:26:49.829768 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:49.829672 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" event={"ID":"a996a8cb-e178-47d2-bca4-023703af4dc7","Type":"ContainerStarted","Data":"5b001cf70cc38df7c46f5d863ee4cfaf9241beb3ffe0412074dbf0de750e88ce"} Jul 13 19:26:49.849458 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:26:49.849411 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" podStartSLOduration=2.5068518749999997 podStartE2EDuration="6.849396488s" totalImagesPullingTime="4.342544613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:49.847770545 +0000 UTC m=+80.894324816" watchObservedRunningTime="2026-07-13 19:26:49.849396488 +0000 UTC m=+80.895950778" Jul 13 19:27:09.612149 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:27:09.612113 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:27:09.612583 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:27:09.612238 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:27:09.612583 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:27:09.612302 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls podName:2bb1bdb8-3bab-44cd-a3fc-074213c9cd34 nodeName:}" failed. No retries permitted until 2026-07-13 19:28:13.612282686 +0000 UTC m=+164.658836938 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls") pod "dns-default-h8rl5" (UID: "2bb1bdb8-3bab-44cd-a3fc-074213c9cd34") : secret "dns-default-metrics-tls" not found Jul 13 19:27:11.803557 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:27:11.803530 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dfsp6" Jul 13 19:27:39.213196 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:27:39.213150 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:27:39.213613 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:27:39.213310 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 13 19:27:39.213613 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:27:39.213400 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:41.21337231 +0000 UTC m=+252.259926559 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : secret "metrics-daemon-secret" not found Jul 13 19:28:08.793414 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:28:08.793351 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h8rl5" podUID="2bb1bdb8-3bab-44cd-a3fc-074213c9cd34" Jul 13 19:28:09.054476 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:28:09.054449 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8rl5" Jul 13 19:28:10.556106 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:28:10.556062 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:28:13.651621 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:28:13.651579 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:28:13.652204 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:28:13.651778 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 19:28:13.652204 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:28:13.651862 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls podName:2bb1bdb8-3bab-44cd-a3fc-074213c9cd34 nodeName:}" failed. No retries permitted until 2026-07-13 19:30:15.651841454 +0000 UTC m=+286.698395704 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls") pod "dns-default-h8rl5" (UID: "2bb1bdb8-3bab-44cd-a3fc-074213c9cd34") : secret "dns-default-metrics-tls" not found Jul 13 19:28:22.544525 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:28:22.544439 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:28:48.165253 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:28:48.165219 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb498eb9-ed79-4fd6-908c-7acefa921dc4" containerID="6405f94366148744e6085972e99fc29bd89c148fd1f100fda95643f989324af4" exitCode=255 Jul 13 19:28:48.165637 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:28:48.165283 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" event={"ID":"fb498eb9-ed79-4fd6-908c-7acefa921dc4","Type":"ContainerDied","Data":"6405f94366148744e6085972e99fc29bd89c148fd1f100fda95643f989324af4"} Jul 13 19:28:48.165637 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:28:48.165572 2555 scope.go:117] "RemoveContainer" containerID="6405f94366148744e6085972e99fc29bd89c148fd1f100fda95643f989324af4" Jul 13 19:28:49.169647 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:28:49.169613 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bd8f7dfd4-wtzt9" event={"ID":"fb498eb9-ed79-4fd6-908c-7acefa921dc4","Type":"ContainerStarted","Data":"aa799e2152a14da95f3b52ccece03401e8c11fd19967dfff513cb378b7e2044d"} Jul 13 19:29:32.841955 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:32.841922 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:32.927628 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:32.927598 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:35.387210 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:35.387175 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:37.953654 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:37.953617 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:38.130894 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.130862 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:38.222202 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.222130 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:38.354578 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.354548 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:38.402816 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.402778 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nkl7x"] Jul 13 19:29:38.405954 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.405938 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.409067 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.409046 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 19:29:38.409199 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.409087 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 19:29:38.409342 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.409328 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 19:29:38.409542 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.409527 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 19:29:38.410348 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.410334 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qtwnk\"" Jul 13 19:29:38.419420 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.419395 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nkl7x"] Jul 13 19:29:38.445224 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.445192 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:38.545289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.545250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e467f89a-41e7-43dc-8fc6-f88a6335acb7-data-volume\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.545289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.545283 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.545441 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.545326 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.545441 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.545363 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9rjb\" (UniqueName: \"kubernetes.io/projected/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-api-access-b9rjb\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.545511 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.545432 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e467f89a-41e7-43dc-8fc6-f88a6335acb7-crio-socket\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.645962 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.645905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e467f89a-41e7-43dc-8fc6-f88a6335acb7-crio-socket\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.645962 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.645968 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e467f89a-41e7-43dc-8fc6-f88a6335acb7-data-volume\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.646204 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.646006 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.646204 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.646037 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.646204 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.646065 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e467f89a-41e7-43dc-8fc6-f88a6335acb7-crio-socket\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.646204 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.646071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9rjb\" (UniqueName: \"kubernetes.io/projected/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-api-access-b9rjb\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.646204 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:38.646166 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:29:38.646366 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:38.646208 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 19:29:38.646366 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:38.646247 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:39.146226497 +0000 UTC m=+250.192780748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : secret "insights-runtime-extractor-tls" not found Jul 13 19:29:38.646366 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:38.646285 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:39.146258634 +0000 UTC m=+250.192812923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : configmap "kube-rbac-proxy" not found Jul 13 19:29:38.646469 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.646397 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e467f89a-41e7-43dc-8fc6-f88a6335acb7-data-volume\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.657224 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.657203 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9rjb\" (UniqueName: \"kubernetes.io/projected/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-api-access-b9rjb\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:38.822080 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.821969 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:38.877317 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:38.877276 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:39.149374 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:39.149269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:39.149374 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:39.149330 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:39.149800 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:39.149408 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 19:29:39.149800 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:39.149448 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:29:39.149800 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:39.149488 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:40.149462746 +0000 UTC m=+251.196016997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : configmap "kube-rbac-proxy" not found Jul 13 19:29:39.149800 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:39.149512 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:40.149502101 +0000 UTC m=+251.196056350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : secret "insights-runtime-extractor-tls" not found Jul 13 19:29:39.817702 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:39.817668 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:40.156421 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:40.156322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:40.156421 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:40.156382 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:40.156836 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:40.156455 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 19:29:40.156836 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:40.156492 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:29:40.156836 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:40.156532 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:42.156511598 +0000 UTC m=+253.203065863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : configmap "kube-rbac-proxy" not found Jul 13 19:29:40.156836 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:40.156557 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:42.156540026 +0000 UTC m=+253.203094276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : secret "insights-runtime-extractor-tls" not found Jul 13 19:29:40.517883 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:40.517792 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:40.617682 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:40.617652 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:41.265245 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:41.265205 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:29:41.265645 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:41.265325 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 13 19:29:41.265645 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:41.265376 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs podName:9fa025d1-cdfb-41a5-80df-50795d7b36f9 nodeName:}" failed. No retries permitted until 2026-07-13 19:31:43.265362978 +0000 UTC m=+374.311917225 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs") pod "network-metrics-daemon-rm67z" (UID: "9fa025d1-cdfb-41a5-80df-50795d7b36f9") : secret "metrics-daemon-secret" not found Jul 13 19:29:41.321271 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:41.321238 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:41.385873 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:41.385852 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t877d_3a880dc9-d62a-455d-a46b-09e03d167960/dns-node-resolver/0.log" Jul 13 19:29:42.173020 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:42.172962 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:42.173227 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:42.173046 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:42.173227 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:42.173092 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 19:29:42.173227 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:42.173158 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:46.17314362 +0000 UTC m=+257.219697880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : configmap "kube-rbac-proxy" not found Jul 13 19:29:42.173227 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:42.173216 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:29:42.173416 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:42.173294 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:46.173274687 +0000 UTC m=+257.219828936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : secret "insights-runtime-extractor-tls" not found Jul 13 19:29:42.376133 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:42.376103 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m9wqk_75d81a4e-0023-445d-bbee-336e39407e8c/node-ca/0.log" Jul 13 19:29:42.775729 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:42.775697 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kg5n4_4b613bdc-4461-47c2-b357-b14b9aa599d4/serve-healthcheck-canary/0.log" Jul 13 19:29:44.574554 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:44.574516 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:44.712221 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:44.712189 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:45.782152 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:45.782114 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:45.883167 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:45.883133 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:45.967255 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:45.967225 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:46.204495 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:46.204455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:46.204677 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:46.204505 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:46.204677 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:46.204580 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 19:29:46.204677 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:46.204598 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:29:46.204677 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:46.204643 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:54.204629377 +0000 UTC m=+265.251183624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : secret "insights-runtime-extractor-tls" not found Jul 13 19:29:46.204677 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:46.204655 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:54.204648771 +0000 UTC m=+265.251203019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : configmap "kube-rbac-proxy" not found Jul 13 19:29:46.665380 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:46.665350 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:46.906438 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:46.906405 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:46.957258 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:46.957189 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:47.065552 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:47.065521 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:47.268263 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:47.268178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:47.472315 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:47.472285 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:47.869633 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:47.869598 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:48.313787 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:48.313756 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:48.516139 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:48.516104 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:49.066019 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:49.065966 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:50.173474 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:50.173395 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:50.274696 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:50.274663 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:50.329132 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:50.329107 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:50.664836 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:50.664804 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:50.928852 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:50.928757 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:51.268714 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:51.268632 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:51.664374 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:51.664346 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:52.065520 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:52.065489 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:52.391558 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:52.391468 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:52.492926 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:52.492884 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:52.546784 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:52.546753 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:53.240698 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:53.240669 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:53.303823 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:53.303791 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:53.520135 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:53.520048 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:53.867106 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:53.867070 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:54.269128 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:54.269043 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:54.269128 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:54.269089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:54.269301 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:54.269186 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 19:29:54.269301 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:29:54.269252 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls podName:e467f89a-41e7-43dc-8fc6-f88a6335acb7 nodeName:}" failed. No retries permitted until 2026-07-13 19:30:10.269237832 +0000 UTC m=+281.315792080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nkl7x" (UID: "e467f89a-41e7-43dc-8fc6-f88a6335acb7") : secret "insights-runtime-extractor-tls" not found Jul 13 19:29:54.269571 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:54.269552 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e467f89a-41e7-43dc-8fc6-f88a6335acb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:29:54.334658 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:54.334629 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:54.445164 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:54.445122 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:54.501161 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:54.501125 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:54.643954 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:54.643925 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:54.829275 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:54.829244 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:54.928356 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:54.928280 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:55.032046 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:55.032018 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:55.128706 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:55.128679 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:55.230375 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:55.230295 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:55.285916 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:55.285886 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:55.834222 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:55.834190 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:55.890132 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:55.890102 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:56.018132 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:56.018102 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:56.218866 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:56.218789 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:29:56.348699 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:29:56.348668 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:00.021456 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.021425 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-z74j4"] Jul 13 19:30:00.024293 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.024277 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-z74j4" Jul 13 19:30:00.027198 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.027177 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 19:30:00.027686 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.027667 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4hr7b\"" Jul 13 19:30:00.027686 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.027680 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 19:30:00.038545 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.038330 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-z74j4"] Jul 13 19:30:00.109529 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.109489 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz62b\" (UniqueName: \"kubernetes.io/projected/d2cc09df-1bf9-42b6-93ae-2861864d2182-kube-api-access-qz62b\") pod \"downloads-68c9cbb497-z74j4\" (UID: \"d2cc09df-1bf9-42b6-93ae-2861864d2182\") " pod="openshift-console/downloads-68c9cbb497-z74j4" Jul 13 19:30:00.210561 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.210523 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz62b\" (UniqueName: \"kubernetes.io/projected/d2cc09df-1bf9-42b6-93ae-2861864d2182-kube-api-access-qz62b\") pod \"downloads-68c9cbb497-z74j4\" (UID: \"d2cc09df-1bf9-42b6-93ae-2861864d2182\") " pod="openshift-console/downloads-68c9cbb497-z74j4" Jul 13 19:30:00.219611 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.219578 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz62b\" (UniqueName: \"kubernetes.io/projected/d2cc09df-1bf9-42b6-93ae-2861864d2182-kube-api-access-qz62b\") pod \"downloads-68c9cbb497-z74j4\" (UID: \"d2cc09df-1bf9-42b6-93ae-2861864d2182\") " pod="openshift-console/downloads-68c9cbb497-z74j4" Jul 13 19:30:00.333423 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.333390 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-z74j4" Jul 13 19:30:00.457572 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:00.457543 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-z74j4"] Jul 13 19:30:00.460670 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:30:00.460642 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cc09df_1bf9_42b6_93ae_2861864d2182.slice/crio-dd273ff513cf4e6151f4d62a0e02ab3df4081206d8b944b42ad5f6f0708155cf WatchSource:0}: Error finding container dd273ff513cf4e6151f4d62a0e02ab3df4081206d8b944b42ad5f6f0708155cf: Status 404 returned error can't find the container with id dd273ff513cf4e6151f4d62a0e02ab3df4081206d8b944b42ad5f6f0708155cf Jul 13 19:30:01.005929 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:01.005890 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:01.113138 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:01.113109 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:01.380344 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:01.380307 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-z74j4" event={"ID":"d2cc09df-1bf9-42b6-93ae-2861864d2182","Type":"ContainerStarted","Data":"dd273ff513cf4e6151f4d62a0e02ab3df4081206d8b944b42ad5f6f0708155cf"} Jul 13 19:30:03.640230 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:03.640195 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:04.782473 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:04.782436 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:05.928697 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:05.928659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:07.634355 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:07.634319 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:07.694322 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:07.694294 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:07.874854 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:07.874817 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:07.975474 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:07.975380 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:08.040490 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:08.040451 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:08.976031 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:08.975963 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:10.294425 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:10.294383 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:30:10.297320 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:10.297287 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e467f89a-41e7-43dc-8fc6-f88a6335acb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nkl7x\" (UID: \"e467f89a-41e7-43dc-8fc6-f88a6335acb7\") " pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:30:10.514996 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:10.514949 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nkl7x" Jul 13 19:30:10.652772 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:10.652732 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nkl7x"] Jul 13 19:30:10.656517 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:30:10.656485 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode467f89a_41e7_43dc_8fc6_f88a6335acb7.slice/crio-0a5840bfa5f4109634a74e248b9830a3d7d27c5c202849503b3295a5454350ef WatchSource:0}: Error finding container 0a5840bfa5f4109634a74e248b9830a3d7d27c5c202849503b3295a5454350ef: Status 404 returned error can't find the container with id 0a5840bfa5f4109634a74e248b9830a3d7d27c5c202849503b3295a5454350ef Jul 13 19:30:11.418425 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:11.418386 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkl7x" event={"ID":"e467f89a-41e7-43dc-8fc6-f88a6335acb7","Type":"ContainerStarted","Data":"0a5840bfa5f4109634a74e248b9830a3d7d27c5c202849503b3295a5454350ef"} Jul 13 19:30:12.055995 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:30:12.055929 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h8rl5" podUID="2bb1bdb8-3bab-44cd-a3fc-074213c9cd34" Jul 13 19:30:12.063988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.063949 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:12.119898 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.119854 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wldsb"] Jul 13 19:30:12.123154 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.123131 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.127111 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.127082 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 19:30:12.127263 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.127129 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 13 19:30:12.127341 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.127299 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kspxz\"" Jul 13 19:30:12.127443 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.127426 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 19:30:12.127506 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.127088 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 13 19:30:12.127667 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.127648 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 19:30:12.132177 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.132026 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wldsb"] Jul 13 19:30:12.146336 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.146267 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:12.212867 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.212731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.212867 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.212779 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.212867 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.212852 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.213194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.212903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdmj2\" (UniqueName: \"kubernetes.io/projected/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-kube-api-access-qdmj2\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.313992 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.313874 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdmj2\" (UniqueName: \"kubernetes.io/projected/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-kube-api-access-qdmj2\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.313992 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.313947 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.314219 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.313994 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.314219 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.314064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.314219 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:30:12.314108 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 13 19:30:12.314219 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:30:12.314197 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-prometheus-operator-tls podName:4010ce8a-c7ff-4df0-a4b6-cb605edc257c nodeName:}" failed. No retries permitted until 2026-07-13 19:30:12.814174406 +0000 UTC m=+283.860728676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-prometheus-operator-tls") pod "prometheus-operator-64785b6675-wldsb" (UID: "4010ce8a-c7ff-4df0-a4b6-cb605edc257c") : secret "prometheus-operator-tls" not found Jul 13 19:30:12.314830 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.314784 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.317258 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.317233 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.325879 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.325816 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdmj2\" (UniqueName: \"kubernetes.io/projected/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-kube-api-access-qdmj2\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.422274 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.422238 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8rl5" Jul 13 19:30:12.487425 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.487391 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:12.817952 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.817910 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:12.820843 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:12.820819 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4010ce8a-c7ff-4df0-a4b6-cb605edc257c-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wldsb\" (UID: \"4010ce8a-c7ff-4df0-a4b6-cb605edc257c\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:13.036017 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:13.035964 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" Jul 13 19:30:13.698680 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:13.698623 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:15.063639 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:15.063601 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:15.165485 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:15.165445 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:15.740997 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:15.740943 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:30:15.743515 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:15.743491 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bb1bdb8-3bab-44cd-a3fc-074213c9cd34-metrics-tls\") pod \"dns-default-h8rl5\" (UID: \"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34\") " pod="openshift-dns/dns-default-h8rl5" Jul 13 19:30:16.026265 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:16.026179 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nf5fn\"" Jul 13 19:30:16.033466 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:16.033433 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h8rl5" Jul 13 19:30:16.251805 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:16.251747 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:16.310032 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:16.309945 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:16.938592 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:16.938540 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:17.079779 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:17.079744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:17.201503 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:17.201421 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:19.851350 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:19.851307 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:19.950843 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:19.950791 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:20.451203 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:20.451160 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:20.552950 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:20.552917 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:21.685588 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:21.685545 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h8rl5"] Jul 13 19:30:21.689281 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:30:21.689253 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb1bdb8_3bab_44cd_a3fc_074213c9cd34.slice/crio-031aa844cbf281638d5530102cbc553f27056d09c4fc3fb32cc056ea4ec1637e WatchSource:0}: Error finding container 031aa844cbf281638d5530102cbc553f27056d09c4fc3fb32cc056ea4ec1637e: Status 404 returned error can't find the container with id 031aa844cbf281638d5530102cbc553f27056d09c4fc3fb32cc056ea4ec1637e Jul 13 19:30:21.701907 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:21.701880 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wldsb"] Jul 13 19:30:21.705563 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:30:21.705536 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4010ce8a_c7ff_4df0_a4b6_cb605edc257c.slice/crio-7f0123f4e8e7c3b14e617bf8a8581ba9f5010af72825c85f6ad41640b09ac7cf WatchSource:0}: Error finding container 7f0123f4e8e7c3b14e617bf8a8581ba9f5010af72825c85f6ad41640b09ac7cf: Status 404 returned error can't find the container with id 7f0123f4e8e7c3b14e617bf8a8581ba9f5010af72825c85f6ad41640b09ac7cf Jul 13 19:30:22.457809 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:22.457389 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-z74j4" event={"ID":"d2cc09df-1bf9-42b6-93ae-2861864d2182","Type":"ContainerStarted","Data":"5420e6c4c82b1df5765750ad5a38404954aeb14b57c0e583141874cefbab09ca"} Jul 13 19:30:22.457809 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:22.457564 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-z74j4" Jul 13 19:30:22.459505 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:22.459475 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkl7x" event={"ID":"e467f89a-41e7-43dc-8fc6-f88a6335acb7","Type":"ContainerStarted","Data":"939fbf50444f186f5f25424c1cf01080a9ca42f7e22490caeee82b7a7ae75d82"} Jul 13 19:30:22.460756 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:22.460732 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" event={"ID":"4010ce8a-c7ff-4df0-a4b6-cb605edc257c","Type":"ContainerStarted","Data":"7f0123f4e8e7c3b14e617bf8a8581ba9f5010af72825c85f6ad41640b09ac7cf"} Jul 13 19:30:22.461882 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:22.461854 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8rl5" event={"ID":"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34","Type":"ContainerStarted","Data":"031aa844cbf281638d5530102cbc553f27056d09c4fc3fb32cc056ea4ec1637e"} Jul 13 19:30:22.473635 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:22.473610 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-z74j4" Jul 13 19:30:22.477903 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:22.477862 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-z74j4" podStartSLOduration=2.397356901 podStartE2EDuration="23.477843659s" totalImagesPullingTime="21.080486758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:22.475581556 +0000 UTC m=+293.522135853" watchObservedRunningTime="2026-07-13 19:30:22.477843659 +0000 UTC m=+293.524397907" Jul 13 19:30:23.507031 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:23.506995 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:23.607414 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:23.607359 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:24.061703 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:24.061646 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:24.163861 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:24.163784 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:24.265934 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:24.265895 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:25.109006 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:25.108916 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:25.477334 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:25.477252 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" event={"ID":"4010ce8a-c7ff-4df0-a4b6-cb605edc257c","Type":"ContainerStarted","Data":"479085030fbbb826552ef65cf4ae512d578404718d99a7ac1278fe655e690a68"} Jul 13 19:30:25.477555 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:25.477360 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" event={"ID":"4010ce8a-c7ff-4df0-a4b6-cb605edc257c","Type":"ContainerStarted","Data":"b2e612fe62f35137ad30e5c4a40192214d48dd6a2234ab51a1342fb77c7cecd9"} Jul 13 19:30:25.479523 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:25.479486 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8rl5" event={"ID":"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34","Type":"ContainerStarted","Data":"b3d73bfd6208dfb1b9b0738d671244275bceb15625d0895856f0813943905dad"} Jul 13 19:30:25.479640 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:25.479542 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h8rl5" event={"ID":"2bb1bdb8-3bab-44cd-a3fc-074213c9cd34","Type":"ContainerStarted","Data":"e4c962848ed21105b94b5db398efc14fbd04c7f747c4b27460ef71092a601c90"} Jul 13 19:30:25.479640 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:25.479608 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h8rl5" Jul 13 19:30:25.499278 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:25.499188 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-wldsb" podStartSLOduration=10.458099108 podStartE2EDuration="13.499167538s" totalImagesPullingTime="3.04106843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:25.497321652 +0000 UTC m=+296.543875927" watchObservedRunningTime="2026-07-13 19:30:25.499167538 +0000 UTC m=+296.545721810" Jul 13 19:30:25.529496 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:25.529436 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h8rl5" podStartSLOduration=257.466786444 podStartE2EDuration="4m20.529415569s" totalImagesPullingTime="3.062629125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:25.525346124 +0000 UTC m=+296.571900416" watchObservedRunningTime="2026-07-13 19:30:25.529415569 +0000 UTC m=+296.575969871" Jul 13 19:30:25.545649 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:30:25.545587 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rm67z" podUID="9fa025d1-cdfb-41a5-80df-50795d7b36f9" Jul 13 19:30:26.485309 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:26.485224 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkl7x" event={"ID":"e467f89a-41e7-43dc-8fc6-f88a6335acb7","Type":"ContainerStarted","Data":"812af664aae87b29cb53fa1cad1445c5d68a1b0687968103ffe7ab55a8d77f81"} Jul 13 19:30:27.195666 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.195614 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:27.414923 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.414885 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:27.474733 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.474640 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gtzvg"] Jul 13 19:30:27.496159 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.496095 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.498552 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.498519 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:27.498752 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.498737 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 19:30:27.499148 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.499128 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 19:30:27.499148 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.499146 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 19:30:27.499313 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.499233 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wgvr4\"" Jul 13 19:30:27.642869 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.642836 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvxtv\" (UniqueName: \"kubernetes.io/projected/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-kube-api-access-nvxtv\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.643075 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.642907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-textfile\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.643075 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.642939 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-root\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.643075 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.642994 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.643075 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.643036 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-wtmp\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.643265 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.643083 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.643265 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.643111 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-tls\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.643265 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.643148 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-sys\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.643265 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.643173 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-metrics-client-ca\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744678 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744587 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvxtv\" (UniqueName: \"kubernetes.io/projected/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-kube-api-access-nvxtv\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744678 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744666 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-textfile\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744908 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744692 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-root\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744908 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744723 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744908 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-wtmp\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744908 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744775 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744908 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744804 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-tls\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744908 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744828 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-sys\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744908 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744850 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-metrics-client-ca\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.744908 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.744883 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-root\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.745318 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.745056 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-wtmp\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.745318 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.745079 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-sys\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.745318 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.745110 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-textfile\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.745693 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.745667 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-accelerators-collector-config\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.745943 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.745814 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-metrics-client-ca\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.747798 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.747776 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-tls\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.747890 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.747839 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.753028 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.753003 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvxtv\" (UniqueName: \"kubernetes.io/projected/ddfde8d1-c2f4-4563-b272-33a5f8bc7867-kube-api-access-nvxtv\") pod \"node-exporter-gtzvg\" (UID: \"ddfde8d1-c2f4-4563-b272-33a5f8bc7867\") " pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.807003 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:27.806952 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gtzvg" Jul 13 19:30:27.848181 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:30:27.848150 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfde8d1_c2f4_4563_b272_33a5f8bc7867.slice/crio-658fa9b78f537ac9393630e799250a1596fd57f69fb26770415b006ec2607051 WatchSource:0}: Error finding container 658fa9b78f537ac9393630e799250a1596fd57f69fb26770415b006ec2607051: Status 404 returned error can't find the container with id 658fa9b78f537ac9393630e799250a1596fd57f69fb26770415b006ec2607051 Jul 13 19:30:28.499855 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:28.499812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtzvg" event={"ID":"ddfde8d1-c2f4-4563-b272-33a5f8bc7867","Type":"ContainerStarted","Data":"658fa9b78f537ac9393630e799250a1596fd57f69fb26770415b006ec2607051"} Jul 13 19:30:29.073610 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:29.073555 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:29.137550 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:29.137505 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:29.397773 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:29.397706 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:30:29.398420 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:29.398395 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:30:29.404816 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:29.404787 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 19:30:30.369217 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:30.369187 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:30.430413 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:30.430381 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:30.516142 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:30.516087 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:30.714243 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:30.714162 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:31.515179 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:31.515082 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nkl7x" event={"ID":"e467f89a-41e7-43dc-8fc6-f88a6335acb7","Type":"ContainerStarted","Data":"ab4a6b8538b691c364497ce3fa650826e5e67cb900dedf0e1d2ac18b73c9b5eb"} Jul 13 19:30:31.534282 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:31.534234 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nkl7x" podStartSLOduration=33.200636461 podStartE2EDuration="53.534216872s" totalImagesPullingTime="20.333580411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:29:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:31.533292336 +0000 UTC m=+302.579846631" watchObservedRunningTime="2026-07-13 19:30:31.534216872 +0000 UTC m=+302.580771149" Jul 13 19:30:32.230101 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:32.230070 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:32.293080 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:32.293052 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:32.398860 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:32.398785 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:32.494609 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:32.494577 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:32.520076 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:32.520044 2555 generic.go:356] "Generic (PLEG): container finished" podID="ddfde8d1-c2f4-4563-b272-33a5f8bc7867" containerID="5955e479e060da893cc96cc37cc38233dd3ef75fbfffd59e93f0dfc3e151ea62" exitCode=0 Jul 13 19:30:32.520538 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:32.520135 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtzvg" event={"ID":"ddfde8d1-c2f4-4563-b272-33a5f8bc7867","Type":"ContainerDied","Data":"5955e479e060da893cc96cc37cc38233dd3ef75fbfffd59e93f0dfc3e151ea62"} Jul 13 19:30:33.528030 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:33.527965 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtzvg" event={"ID":"ddfde8d1-c2f4-4563-b272-33a5f8bc7867","Type":"ContainerStarted","Data":"f7633352239f52a5267b7b8a72f7253e43e4b2fec8772d4588e83c10c617a594"} Jul 13 19:30:33.528618 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:33.528101 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gtzvg" event={"ID":"ddfde8d1-c2f4-4563-b272-33a5f8bc7867","Type":"ContainerStarted","Data":"6d56e82802c6c22cccdce250d4e847c97ab72be9220f3299f9d1e5fe8b99ffb7"} Jul 13 19:30:33.549910 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:33.549858 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gtzvg" podStartSLOduration=2.236993251 podStartE2EDuration="6.549840662s" totalImagesPullingTime="4.208015388s" totalInitContainerRuntime="104.832023ms" isStatefulPod=true podCreationTimestamp="2026-07-13 19:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:33.547813411 +0000 UTC m=+304.594367684" watchObservedRunningTime="2026-07-13 19:30:33.549840662 +0000 UTC m=+304.596394958" Jul 13 19:30:33.639894 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:33.639858 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:35.156518 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:35.156486 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:35.487631 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:35.487557 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h8rl5" Jul 13 19:30:36.569890 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:36.569856 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:37.658094 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:37.658066 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:37.757264 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:37.757227 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:40.544718 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:40.544691 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:30:46.588584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:46.588550 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:46.692377 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:46.692343 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:47.195856 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:47.195820 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:47.253703 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:47.253674 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:47.309478 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:47.309449 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:52.382745 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:52.382712 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:52.437488 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:52.437452 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:30:54.265274 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:30:54.265228 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" podUID="a996a8cb-e178-47d2-bca4-023703af4dc7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 13 19:31:04.265364 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:04.265327 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" podUID="a996a8cb-e178-47d2-bca4-023703af4dc7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 13 19:31:07.388958 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:07.388919 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:07.487332 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:07.487297 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:14.265330 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:14.265285 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" podUID="a996a8cb-e178-47d2-bca4-023703af4dc7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 13 19:31:14.265770 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:14.265359 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" Jul 13 19:31:14.265929 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:14.265899 2555 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"620359c9436690067ef597d87b027f2e2397cad511a6489968a227fa32483b85"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 13 19:31:14.265972 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:14.265954 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" podUID="a996a8cb-e178-47d2-bca4-023703af4dc7" containerName="service-proxy" containerID="cri-o://620359c9436690067ef597d87b027f2e2397cad511a6489968a227fa32483b85" gracePeriod=30 Jul 13 19:31:14.659095 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:14.659047 2555 generic.go:356] "Generic (PLEG): container finished" podID="a996a8cb-e178-47d2-bca4-023703af4dc7" containerID="620359c9436690067ef597d87b027f2e2397cad511a6489968a227fa32483b85" exitCode=2 Jul 13 19:31:14.659306 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:14.659117 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" event={"ID":"a996a8cb-e178-47d2-bca4-023703af4dc7","Type":"ContainerDied","Data":"620359c9436690067ef597d87b027f2e2397cad511a6489968a227fa32483b85"} Jul 13 19:31:14.659306 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:14.659172 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cb66d49db-bq5xs" event={"ID":"a996a8cb-e178-47d2-bca4-023703af4dc7","Type":"ContainerStarted","Data":"88089c538abba4b719d56fd2ea9e28373c90bcd65045f8dacfeb1e2fa9bde42a"} Jul 13 19:31:25.369243 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:25.369163 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:25.468036 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:25.467991 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:43.327451 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.327410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:31:43.329876 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.329852 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fa025d1-cdfb-41a5-80df-50795d7b36f9-metrics-certs\") pod \"network-metrics-daemon-rm67z\" (UID: \"9fa025d1-cdfb-41a5-80df-50795d7b36f9\") " pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:31:43.525756 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.525718 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:43.547757 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.547736 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzrsk\"" Jul 13 19:31:43.556188 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.556165 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm67z" Jul 13 19:31:43.624713 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.624682 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:43.679604 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.679574 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm67z"] Jul 13 19:31:43.682375 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:31:43.682351 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa025d1_cdfb_41a5_80df_50795d7b36f9.slice/crio-f1ea3c53d544bf7b1ef04b1d338416426dd0884166173d4e657364e20bc83773 WatchSource:0}: Error finding container f1ea3c53d544bf7b1ef04b1d338416426dd0884166173d4e657364e20bc83773: Status 404 returned error can't find the container with id f1ea3c53d544bf7b1ef04b1d338416426dd0884166173d4e657364e20bc83773 Jul 13 19:31:43.684266 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.684247 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 19:31:43.755858 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.755827 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm67z" event={"ID":"9fa025d1-cdfb-41a5-80df-50795d7b36f9","Type":"ContainerStarted","Data":"f1ea3c53d544bf7b1ef04b1d338416426dd0884166173d4e657364e20bc83773"} Jul 13 19:31:43.972374 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:43.972289 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:44.037828 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:44.037794 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:45.764669 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:45.764639 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm67z" event={"ID":"9fa025d1-cdfb-41a5-80df-50795d7b36f9","Type":"ContainerStarted","Data":"b759d417b99b54f107aa290523cfa253ed873a9379b9a5b8e3a8fc353e5db6e9"} Jul 13 19:31:45.765080 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:45.764689 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm67z" event={"ID":"9fa025d1-cdfb-41a5-80df-50795d7b36f9","Type":"ContainerStarted","Data":"d43e67dcb708c1a6c905fc94a955eeb423ceeac34556399d31caa010f5c2b823"} Jul 13 19:31:45.781299 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:45.781243 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rm67z" podStartSLOduration=375.400105898 podStartE2EDuration="6m16.781228557s" totalImagesPullingTime="1.381122659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:31:45.780350867 +0000 UTC m=+376.826905150" watchObservedRunningTime="2026-07-13 19:31:45.781228557 +0000 UTC m=+376.827782827" Jul 13 19:31:45.883880 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:45.883848 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:46.073789 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:46.073737 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:46.366004 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:46.365917 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:55.496120 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:55.496083 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:55.555379 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:55.555347 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:57.479156 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:57.479124 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:57.580167 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:57.580136 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:31:57.639245 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:31:57.639207 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:32:07.396878 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:32:07.396846 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:32:07.494941 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:32:07.494913 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:32:23.179965 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:32:23.179926 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:32:29.092093 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:32:29.092057 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:32:54.010685 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:32:54.010595 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:32:54.112087 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:32:54.112053 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:20.796277 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:20.796241 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:21.587928 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:21.587893 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:22.671257 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.671213 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb"] Jul 13 19:33:22.673218 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.673198 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" Jul 13 19:33:22.676025 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.676004 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:33:22.676152 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.676053 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 19:33:22.676236 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.676213 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bm7tp\"" Jul 13 19:33:22.688493 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.688472 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb"] Jul 13 19:33:22.785617 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.785589 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd624\" (UniqueName: \"kubernetes.io/projected/7cd50d33-0195-452c-9584-9c87b4e3cde0-kube-api-access-rd624\") pod \"cert-manager-operator-controller-manager-55c444bf86-5glpb\" (UID: \"7cd50d33-0195-452c-9584-9c87b4e3cde0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" Jul 13 19:33:22.785774 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.785625 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cd50d33-0195-452c-9584-9c87b4e3cde0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5glpb\" (UID: \"7cd50d33-0195-452c-9584-9c87b4e3cde0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" Jul 13 19:33:22.886242 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.886211 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd624\" (UniqueName: \"kubernetes.io/projected/7cd50d33-0195-452c-9584-9c87b4e3cde0-kube-api-access-rd624\") pod \"cert-manager-operator-controller-manager-55c444bf86-5glpb\" (UID: \"7cd50d33-0195-452c-9584-9c87b4e3cde0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" Jul 13 19:33:22.886242 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.886245 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cd50d33-0195-452c-9584-9c87b4e3cde0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5glpb\" (UID: \"7cd50d33-0195-452c-9584-9c87b4e3cde0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" Jul 13 19:33:22.886562 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.886546 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cd50d33-0195-452c-9584-9c87b4e3cde0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5glpb\" (UID: \"7cd50d33-0195-452c-9584-9c87b4e3cde0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" Jul 13 19:33:22.895666 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.895638 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd624\" (UniqueName: \"kubernetes.io/projected/7cd50d33-0195-452c-9584-9c87b4e3cde0-kube-api-access-rd624\") pod \"cert-manager-operator-controller-manager-55c444bf86-5glpb\" (UID: \"7cd50d33-0195-452c-9584-9c87b4e3cde0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" Jul 13 19:33:22.981679 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:22.981598 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" Jul 13 19:33:23.114940 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:23.114914 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb"] Jul 13 19:33:23.118592 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:33:23.118568 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd50d33_0195_452c_9584_9c87b4e3cde0.slice/crio-ac62d7ea10f85da8ef76b47ec0bebbd98cd267914c96911bfadf4dbcbb2fecc5 WatchSource:0}: Error finding container ac62d7ea10f85da8ef76b47ec0bebbd98cd267914c96911bfadf4dbcbb2fecc5: Status 404 returned error can't find the container with id ac62d7ea10f85da8ef76b47ec0bebbd98cd267914c96911bfadf4dbcbb2fecc5 Jul 13 19:33:24.081608 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:24.081567 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" event={"ID":"7cd50d33-0195-452c-9584-9c87b4e3cde0","Type":"ContainerStarted","Data":"ac62d7ea10f85da8ef76b47ec0bebbd98cd267914c96911bfadf4dbcbb2fecc5"} Jul 13 19:33:24.361550 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:24.361460 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:24.463745 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:24.463700 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:26.090354 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:26.090321 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" event={"ID":"7cd50d33-0195-452c-9584-9c87b4e3cde0","Type":"ContainerStarted","Data":"c15f4826f889bc94e6d1fc7d72c92de7ed73437b1315196be31041e7fa6ed436"} Jul 13 19:33:26.112542 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:26.112493 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5glpb" podStartSLOduration=1.491241684 podStartE2EDuration="4.112472972s" totalImagesPullingTime="2.621231288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:33:26.111050531 +0000 UTC m=+477.157604811" watchObservedRunningTime="2026-07-13 19:33:26.112472972 +0000 UTC m=+477.159027242" Jul 13 19:33:26.472304 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:26.472225 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:26.576111 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:26.576077 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:28.842166 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:28.842134 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:29.252577 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:29.252503 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:31.143488 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:31.143462 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:31.246491 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:31.246454 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:35.438677 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:35.438642 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:35.492684 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:35.492653 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:36.043474 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:36.043437 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:37.306395 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.306361 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qk7p5"] Jul 13 19:33:37.309228 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.309207 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qk7p5" Jul 13 19:33:37.311951 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.311928 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 19:33:37.312065 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.312008 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mhsf8\"" Jul 13 19:33:37.312065 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.312039 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 19:33:37.318630 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.318610 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qk7p5"] Jul 13 19:33:37.398242 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.398214 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r95gm\" (UniqueName: \"kubernetes.io/projected/8ed42b3e-a433-4199-9319-adf9b67cfbef-kube-api-access-r95gm\") pod \"cert-manager-55b4d954d5-qk7p5\" (UID: \"8ed42b3e-a433-4199-9319-adf9b67cfbef\") " pod="cert-manager/cert-manager-55b4d954d5-qk7p5" Jul 13 19:33:37.398359 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.398248 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ed42b3e-a433-4199-9319-adf9b67cfbef-bound-sa-token\") pod \"cert-manager-55b4d954d5-qk7p5\" (UID: \"8ed42b3e-a433-4199-9319-adf9b67cfbef\") " pod="cert-manager/cert-manager-55b4d954d5-qk7p5" Jul 13 19:33:37.499512 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.499483 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r95gm\" (UniqueName: \"kubernetes.io/projected/8ed42b3e-a433-4199-9319-adf9b67cfbef-kube-api-access-r95gm\") pod \"cert-manager-55b4d954d5-qk7p5\" (UID: \"8ed42b3e-a433-4199-9319-adf9b67cfbef\") " pod="cert-manager/cert-manager-55b4d954d5-qk7p5" Jul 13 19:33:37.499636 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.499518 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ed42b3e-a433-4199-9319-adf9b67cfbef-bound-sa-token\") pod \"cert-manager-55b4d954d5-qk7p5\" (UID: \"8ed42b3e-a433-4199-9319-adf9b67cfbef\") " pod="cert-manager/cert-manager-55b4d954d5-qk7p5" Jul 13 19:33:37.507877 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.507847 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ed42b3e-a433-4199-9319-adf9b67cfbef-bound-sa-token\") pod \"cert-manager-55b4d954d5-qk7p5\" (UID: \"8ed42b3e-a433-4199-9319-adf9b67cfbef\") " pod="cert-manager/cert-manager-55b4d954d5-qk7p5" Jul 13 19:33:37.508427 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.508409 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r95gm\" (UniqueName: \"kubernetes.io/projected/8ed42b3e-a433-4199-9319-adf9b67cfbef-kube-api-access-r95gm\") pod \"cert-manager-55b4d954d5-qk7p5\" (UID: \"8ed42b3e-a433-4199-9319-adf9b67cfbef\") " pod="cert-manager/cert-manager-55b4d954d5-qk7p5" Jul 13 19:33:37.617257 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.617193 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qk7p5" Jul 13 19:33:37.746096 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:37.746077 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qk7p5"] Jul 13 19:33:37.748694 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:33:37.748663 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ed42b3e_a433_4199_9319_adf9b67cfbef.slice/crio-f01b783faa1e7ade4b0c09f79acc8982b3992f3a96d99985085f7cfd18883b30 WatchSource:0}: Error finding container f01b783faa1e7ade4b0c09f79acc8982b3992f3a96d99985085f7cfd18883b30: Status 404 returned error can't find the container with id f01b783faa1e7ade4b0c09f79acc8982b3992f3a96d99985085f7cfd18883b30 Jul 13 19:33:38.129028 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:38.128991 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qk7p5" event={"ID":"8ed42b3e-a433-4199-9319-adf9b67cfbef","Type":"ContainerStarted","Data":"f01b783faa1e7ade4b0c09f79acc8982b3992f3a96d99985085f7cfd18883b30"} Jul 13 19:33:38.818216 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:38.818182 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:38.910201 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:38.910167 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:40.659910 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.659878 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv"] Jul 13 19:33:40.662811 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.662792 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" Jul 13 19:33:40.665706 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.665677 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 19:33:40.665798 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.665677 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 19:33:40.665798 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.665681 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9n889\"" Jul 13 19:33:40.670603 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.670586 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv"] Jul 13 19:33:40.827541 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.827504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59fe1dbb-eee9-4244-b873-a6c2c10a216d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8nsdv\" (UID: \"59fe1dbb-eee9-4244-b873-a6c2c10a216d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" Jul 13 19:33:40.827541 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.827547 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srd66\" (UniqueName: \"kubernetes.io/projected/59fe1dbb-eee9-4244-b873-a6c2c10a216d-kube-api-access-srd66\") pod \"openshift-lws-operator-fd8ccff4c-8nsdv\" (UID: \"59fe1dbb-eee9-4244-b873-a6c2c10a216d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" Jul 13 19:33:40.928730 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.928645 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59fe1dbb-eee9-4244-b873-a6c2c10a216d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8nsdv\" (UID: \"59fe1dbb-eee9-4244-b873-a6c2c10a216d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" Jul 13 19:33:40.928730 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.928690 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srd66\" (UniqueName: \"kubernetes.io/projected/59fe1dbb-eee9-4244-b873-a6c2c10a216d-kube-api-access-srd66\") pod \"openshift-lws-operator-fd8ccff4c-8nsdv\" (UID: \"59fe1dbb-eee9-4244-b873-a6c2c10a216d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" Jul 13 19:33:40.929088 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.929065 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59fe1dbb-eee9-4244-b873-a6c2c10a216d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8nsdv\" (UID: \"59fe1dbb-eee9-4244-b873-a6c2c10a216d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" Jul 13 19:33:40.939790 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.939763 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srd66\" (UniqueName: \"kubernetes.io/projected/59fe1dbb-eee9-4244-b873-a6c2c10a216d-kube-api-access-srd66\") pod \"openshift-lws-operator-fd8ccff4c-8nsdv\" (UID: \"59fe1dbb-eee9-4244-b873-a6c2c10a216d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" Jul 13 19:33:40.972722 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:40.972698 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" Jul 13 19:33:41.097785 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:41.097751 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv"] Jul 13 19:33:41.101270 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:33:41.101242 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59fe1dbb_eee9_4244_b873_a6c2c10a216d.slice/crio-01f0050d3ccc1583b79d13ae13cb7c98bd697ecf7fafd36ecfa0e566bad13eba WatchSource:0}: Error finding container 01f0050d3ccc1583b79d13ae13cb7c98bd697ecf7fafd36ecfa0e566bad13eba: Status 404 returned error can't find the container with id 01f0050d3ccc1583b79d13ae13cb7c98bd697ecf7fafd36ecfa0e566bad13eba Jul 13 19:33:41.139968 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:41.139937 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" event={"ID":"59fe1dbb-eee9-4244-b873-a6c2c10a216d","Type":"ContainerStarted","Data":"01f0050d3ccc1583b79d13ae13cb7c98bd697ecf7fafd36ecfa0e566bad13eba"} Jul 13 19:33:46.167617 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:46.167572 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qk7p5" event={"ID":"8ed42b3e-a433-4199-9319-adf9b67cfbef","Type":"ContainerStarted","Data":"27ce4cc595dfa21223ed2821727b201fadf69076220d9f8f7d619052d88f385e"} Jul 13 19:33:46.169255 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:46.169215 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" event={"ID":"59fe1dbb-eee9-4244-b873-a6c2c10a216d","Type":"ContainerStarted","Data":"b17afe1b140d03b45c0f7822f85710eadf5e3720df23cf89e0fe4c8741075672"} Jul 13 19:33:46.187494 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:46.187442 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qk7p5" podStartSLOduration=1.842421149 podStartE2EDuration="9.187427314s" totalImagesPullingTime="7.345006165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:33:46.185517944 +0000 UTC m=+497.232072214" watchObservedRunningTime="2026-07-13 19:33:46.187427314 +0000 UTC m=+497.233981584" Jul 13 19:33:46.214423 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:46.214375 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8nsdv" podStartSLOduration=2.222728918 podStartE2EDuration="6.214358513s" totalImagesPullingTime="3.991629595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:33:46.212839585 +0000 UTC m=+497.259393855" watchObservedRunningTime="2026-07-13 19:33:46.214358513 +0000 UTC m=+497.260912783" Jul 13 19:33:46.888800 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:46.888749 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:46.989389 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:46.989321 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:33:48.934024 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:33:48.933962 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:03.774914 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:03.774878 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:03.880822 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:03.880781 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:04.457222 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.457184 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:04.686401 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.686364 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:04.791825 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.791739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:04.831997 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.831939 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl"] Jul 13 19:34:04.837679 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.837656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:04.844524 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.844505 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t9khf\"" Jul 13 19:34:04.846113 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.846098 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 19:34:04.846542 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.846530 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 19:34:04.846595 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.846584 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 19:34:04.846708 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.846696 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 19:34:04.851156 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.851135 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl"] Jul 13 19:34:04.907754 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.907720 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxjh\" (UniqueName: \"kubernetes.io/projected/6b54f626-3ae1-466e-88e1-20f78c2e4809-kube-api-access-4zxjh\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:04.907754 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.907763 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b54f626-3ae1-466e-88e1-20f78c2e4809-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:04.908035 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.907871 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b54f626-3ae1-466e-88e1-20f78c2e4809-tmp\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:04.908035 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.907915 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b54f626-3ae1-466e-88e1-20f78c2e4809-manifests\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:04.908035 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.907944 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b54f626-3ae1-466e-88e1-20f78c2e4809-webhook-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:04.973461 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:04.973412 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:05.009132 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.009090 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b54f626-3ae1-466e-88e1-20f78c2e4809-manifests\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.009319 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.009142 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b54f626-3ae1-466e-88e1-20f78c2e4809-webhook-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.009319 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.009201 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxjh\" (UniqueName: \"kubernetes.io/projected/6b54f626-3ae1-466e-88e1-20f78c2e4809-kube-api-access-4zxjh\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.009319 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.009248 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b54f626-3ae1-466e-88e1-20f78c2e4809-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.009503 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.009435 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b54f626-3ae1-466e-88e1-20f78c2e4809-tmp\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.009573 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.009557 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b54f626-3ae1-466e-88e1-20f78c2e4809-manifests\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.011638 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.011609 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b54f626-3ae1-466e-88e1-20f78c2e4809-tmp\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.011843 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.011824 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b54f626-3ae1-466e-88e1-20f78c2e4809-webhook-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.011916 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.011901 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b54f626-3ae1-466e-88e1-20f78c2e4809-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.023689 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.023665 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxjh\" (UniqueName: \"kubernetes.io/projected/6b54f626-3ae1-466e-88e1-20f78c2e4809-kube-api-access-4zxjh\") pod \"opendatahub-operator-controller-manager-699d4944b8-5kbzl\" (UID: \"6b54f626-3ae1-466e-88e1-20f78c2e4809\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.082091 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.082055 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:05.148002 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.147954 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:05.184662 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.184629 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:05.279722 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.279690 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:05.289275 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.289243 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl"] Jul 13 19:34:05.292689 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:34:05.292663 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b54f626_3ae1_466e_88e1_20f78c2e4809.slice/crio-1d2efad08b4cb295dbb1b7ba82ed0d79a3e438807bf163de58f4ce0ac2068173 WatchSource:0}: Error finding container 1d2efad08b4cb295dbb1b7ba82ed0d79a3e438807bf163de58f4ce0ac2068173: Status 404 returned error can't find the container with id 1d2efad08b4cb295dbb1b7ba82ed0d79a3e438807bf163de58f4ce0ac2068173 Jul 13 19:34:05.347411 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.347336 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:05.452422 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.452388 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:05.547393 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:05.547357 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:06.251834 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:06.251797 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" event={"ID":"6b54f626-3ae1-466e-88e1-20f78c2e4809","Type":"ContainerStarted","Data":"1d2efad08b4cb295dbb1b7ba82ed0d79a3e438807bf163de58f4ce0ac2068173"} Jul 13 19:34:07.211257 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:07.211215 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:07.316733 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:07.316698 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:09.270732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:09.270690 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" event={"ID":"6b54f626-3ae1-466e-88e1-20f78c2e4809","Type":"ContainerStarted","Data":"178b3ec7fde9d5dc2762489ed228777489614377cf593d3e47c6cc9c87ee94b9"} Jul 13 19:34:10.276457 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:10.276421 2555 generic.go:356] "Generic (PLEG): container finished" podID="6b54f626-3ae1-466e-88e1-20f78c2e4809" containerID="178b3ec7fde9d5dc2762489ed228777489614377cf593d3e47c6cc9c87ee94b9" exitCode=0 Jul 13 19:34:10.276869 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:10.276510 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" event={"ID":"6b54f626-3ae1-466e-88e1-20f78c2e4809","Type":"ContainerDied","Data":"178b3ec7fde9d5dc2762489ed228777489614377cf593d3e47c6cc9c87ee94b9"} Jul 13 19:34:12.286188 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:12.286148 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" event={"ID":"6b54f626-3ae1-466e-88e1-20f78c2e4809","Type":"ContainerStarted","Data":"29cf159d3fd543b9677d9748d2b9a9af112eb514b1e4f26f511c957b8abdca86"} Jul 13 19:34:12.286647 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:12.286367 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:12.310114 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:12.310065 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" podStartSLOduration=2.534800921 podStartE2EDuration="8.310047526s" totalImagesPullingTime="4.770621382s" totalInitContainerRuntime="1.004625223s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:34:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:34:12.308383259 +0000 UTC m=+523.354937583" watchObservedRunningTime="2026-07-13 19:34:12.310047526 +0000 UTC m=+523.356601798" Jul 13 19:34:23.292442 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:23.292361 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-5kbzl" Jul 13 19:34:25.116070 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:25.116025 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:25.327119 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:25.327084 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:25.884029 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:25.883956 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:25.953464 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:25.953412 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:26.056525 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:26.056481 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:27.539515 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:27.539464 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:27.593646 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:27.593583 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:35.124623 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.124587 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx"] Jul 13 19:34:35.129238 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.129222 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.133508 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.133484 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 19:34:35.133508 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.133502 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5pxxl\"" Jul 13 19:34:35.133661 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.133522 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 19:34:35.133661 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.133533 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 19:34:35.145840 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.145819 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx"] Jul 13 19:34:35.237590 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.237563 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed146606-7c76-4a29-82cf-362e266729f0-cert\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.237732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.237606 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ed146606-7c76-4a29-82cf-362e266729f0-manager-config\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.237732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.237637 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed146606-7c76-4a29-82cf-362e266729f0-metrics-cert\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.237732 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.237720 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7xm8\" (UniqueName: \"kubernetes.io/projected/ed146606-7c76-4a29-82cf-362e266729f0-kube-api-access-g7xm8\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.338206 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.338177 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7xm8\" (UniqueName: \"kubernetes.io/projected/ed146606-7c76-4a29-82cf-362e266729f0-kube-api-access-g7xm8\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.338318 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.338237 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed146606-7c76-4a29-82cf-362e266729f0-cert\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.338318 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.338274 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ed146606-7c76-4a29-82cf-362e266729f0-manager-config\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.338318 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.338300 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed146606-7c76-4a29-82cf-362e266729f0-metrics-cert\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.339017 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.338942 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ed146606-7c76-4a29-82cf-362e266729f0-manager-config\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.340793 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.340771 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed146606-7c76-4a29-82cf-362e266729f0-metrics-cert\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.340878 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.340818 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed146606-7c76-4a29-82cf-362e266729f0-cert\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.348958 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.348935 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7xm8\" (UniqueName: \"kubernetes.io/projected/ed146606-7c76-4a29-82cf-362e266729f0-kube-api-access-g7xm8\") pod \"lws-controller-manager-75894cfc5c-p87lx\" (UID: \"ed146606-7c76-4a29-82cf-362e266729f0\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.438445 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.438381 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:35.570294 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.570266 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx"] Jul 13 19:34:35.573015 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:34:35.572971 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded146606_7c76_4a29_82cf_362e266729f0.slice/crio-51c7ab813b80f9f6e26f6ac4612b8696bf3be168294b9e44217dedfca093e158 WatchSource:0}: Error finding container 51c7ab813b80f9f6e26f6ac4612b8696bf3be168294b9e44217dedfca093e158: Status 404 returned error can't find the container with id 51c7ab813b80f9f6e26f6ac4612b8696bf3be168294b9e44217dedfca093e158 Jul 13 19:34:35.868140 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.868107 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:35.994612 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:35.994572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:36.105003 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:36.104946 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:36.294468 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:36.294384 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:36.376887 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:36.376851 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" event={"ID":"ed146606-7c76-4a29-82cf-362e266729f0","Type":"ContainerStarted","Data":"51c7ab813b80f9f6e26f6ac4612b8696bf3be168294b9e44217dedfca093e158"} Jul 13 19:34:36.577747 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:36.577711 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:36.678484 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:36.678455 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:37.374445 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:37.374360 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:37.382280 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:37.382251 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" event={"ID":"ed146606-7c76-4a29-82cf-362e266729f0","Type":"ContainerStarted","Data":"ae69e16038b7dd927f5f07ae5a97ba105874bcecc683bce8d3d3ebaca762227d"} Jul 13 19:34:37.382420 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:37.382350 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:37.420652 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:37.420612 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" podStartSLOduration=0.912387651 podStartE2EDuration="2.42059872s" totalImagesPullingTime="1.508211069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:34:37.418358687 +0000 UTC m=+548.464912969" watchObservedRunningTime="2026-07-13 19:34:37.42059872 +0000 UTC m=+548.467152995" Jul 13 19:34:37.487022 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:37.486972 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:38.285326 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:38.285259 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:40.829140 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:40.829105 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:43.091427 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.091393 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:43.190480 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.190445 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:43.769400 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.769371 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c"] Jul 13 19:34:43.776828 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.776806 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.779680 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.779656 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 19:34:43.779812 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.779703 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b87cz\"" Jul 13 19:34:43.779812 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.779743 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 19:34:43.779812 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.779806 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 19:34:43.783581 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.783558 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c"] Jul 13 19:34:43.800190 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.800169 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:43.904266 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.904235 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.904437 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.904271 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3a76269-d523-48de-9e62-2581756dce13-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.904437 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.904296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.904437 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.904341 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25vth\" (UniqueName: \"kubernetes.io/projected/a3a76269-d523-48de-9e62-2581756dce13-kube-api-access-25vth\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.904437 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.904388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3a76269-d523-48de-9e62-2581756dce13-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.904437 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.904433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.904629 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.904493 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.904629 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.904534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3a76269-d523-48de-9e62-2581756dce13-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.904629 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.904562 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:43.917660 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:43.917637 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:44.005281 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005251 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005436 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005293 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3a76269-d523-48de-9e62-2581756dce13-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005436 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005316 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005436 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005336 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005436 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005351 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3a76269-d523-48de-9e62-2581756dce13-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005639 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005517 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005639 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005554 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25vth\" (UniqueName: \"kubernetes.io/projected/a3a76269-d523-48de-9e62-2581756dce13-kube-api-access-25vth\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005639 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005581 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3a76269-d523-48de-9e62-2581756dce13-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005639 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005610 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005820 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005691 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005820 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005705 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.005889 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.005874 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.006211 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.006189 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.006280 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.006261 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3a76269-d523-48de-9e62-2581756dce13-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.007765 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.007746 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3a76269-d523-48de-9e62-2581756dce13-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.007988 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.007958 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3a76269-d523-48de-9e62-2581756dce13-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.012940 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.012923 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3a76269-d523-48de-9e62-2581756dce13-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.013041 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.013021 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25vth\" (UniqueName: \"kubernetes.io/projected/a3a76269-d523-48de-9e62-2581756dce13-kube-api-access-25vth\") pod \"data-science-gateway-data-science-gateway-class-6576859cf44s22c\" (UID: \"a3a76269-d523-48de-9e62-2581756dce13\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.020359 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.020310 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:44.088211 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.088186 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:44.225858 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.225794 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c"] Jul 13 19:34:44.228153 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:34:44.228128 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a76269_d523_48de_9e62_2581756dce13.slice/crio-7817c8cf0d243f8c424667206dfdd63afa3609e6559e3e73c0e0dfb5db082247 WatchSource:0}: Error finding container 7817c8cf0d243f8c424667206dfdd63afa3609e6559e3e73c0e0dfb5db082247: Status 404 returned error can't find the container with id 7817c8cf0d243f8c424667206dfdd63afa3609e6559e3e73c0e0dfb5db082247 Jul 13 19:34:44.413325 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.413289 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" event={"ID":"a3a76269-d523-48de-9e62-2581756dce13","Type":"ContainerStarted","Data":"7817c8cf0d243f8c424667206dfdd63afa3609e6559e3e73c0e0dfb5db082247"} Jul 13 19:34:44.899353 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:44.899320 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:34:46.838698 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:46.838660 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:34:46.838934 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:46.838738 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:34:46.838934 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:46.838766 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:34:47.429203 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:47.429167 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" event={"ID":"a3a76269-d523-48de-9e62-2581756dce13","Type":"ContainerStarted","Data":"ccec0925fe80f7b69bdb55f26c4503d45c65f6a9bec24a14e321ad561b66073f"} Jul 13 19:34:47.449350 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:47.449300 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" podStartSLOduration=1.84096553 podStartE2EDuration="4.449281339s" totalImagesPullingTime="2.608315809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:34:47.449017701 +0000 UTC m=+558.495571984" watchObservedRunningTime="2026-07-13 19:34:47.449281339 +0000 UTC m=+558.495835609" Jul 13 19:34:48.088736 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:48.088701 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:48.093204 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:48.093181 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:48.390545 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:48.390471 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-p87lx" Jul 13 19:34:48.434127 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:48.434030 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:48.435184 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:48.435163 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf44s22c" Jul 13 19:34:56.345691 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:34:56.345659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:26.728718 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.728680 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:26.799051 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.799009 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:26.859110 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.859082 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4l2m"] Jul 13 19:35:26.862338 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.862315 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" Jul 13 19:35:26.866918 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.866898 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-tpqhq\"" Jul 13 19:35:26.868231 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.868211 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 19:35:26.870722 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.870325 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 19:35:26.880938 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.880915 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4l2m"] Jul 13 19:35:26.935970 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.935939 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxbsx\" (UniqueName: \"kubernetes.io/projected/3e59f71c-d22f-422a-a037-b8af32dd806b-kube-api-access-kxbsx\") pod \"kuadrant-operator-catalog-z4l2m\" (UID: \"3e59f71c-d22f-422a-a037-b8af32dd806b\") " pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" Jul 13 19:35:26.936214 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:26.936188 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:27.037249 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.037163 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxbsx\" (UniqueName: \"kubernetes.io/projected/3e59f71c-d22f-422a-a037-b8af32dd806b-kube-api-access-kxbsx\") pod \"kuadrant-operator-catalog-z4l2m\" (UID: \"3e59f71c-d22f-422a-a037-b8af32dd806b\") " pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" Jul 13 19:35:27.045739 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.045705 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxbsx\" (UniqueName: \"kubernetes.io/projected/3e59f71c-d22f-422a-a037-b8af32dd806b-kube-api-access-kxbsx\") pod \"kuadrant-operator-catalog-z4l2m\" (UID: \"3e59f71c-d22f-422a-a037-b8af32dd806b\") " pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" Jul 13 19:35:27.173389 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.173350 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" Jul 13 19:35:27.224763 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.224732 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4l2m"] Jul 13 19:35:27.301734 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.301706 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4l2m"] Jul 13 19:35:27.304665 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:35:27.304634 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e59f71c_d22f_422a_a037_b8af32dd806b.slice/crio-cc0a6aec1344a6b2dd2d572e2e278b02b9e71f949f8fb76f7ba377709bfa7329 WatchSource:0}: Error finding container cc0a6aec1344a6b2dd2d572e2e278b02b9e71f949f8fb76f7ba377709bfa7329: Status 404 returned error can't find the container with id cc0a6aec1344a6b2dd2d572e2e278b02b9e71f949f8fb76f7ba377709bfa7329 Jul 13 19:35:27.432596 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.432562 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m92r6"] Jul 13 19:35:27.436821 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.436803 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m92r6" Jul 13 19:35:27.442733 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.442703 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m92r6"] Jul 13 19:35:27.542008 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.541964 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsn25\" (UniqueName: \"kubernetes.io/projected/6edca6c4-f75e-4bbb-a47d-1fd34fc174bb-kube-api-access-qsn25\") pod \"kuadrant-operator-catalog-m92r6\" (UID: \"6edca6c4-f75e-4bbb-a47d-1fd34fc174bb\") " pod="kuadrant-system/kuadrant-operator-catalog-m92r6" Jul 13 19:35:27.587341 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.587250 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" event={"ID":"3e59f71c-d22f-422a-a037-b8af32dd806b","Type":"ContainerStarted","Data":"cc0a6aec1344a6b2dd2d572e2e278b02b9e71f949f8fb76f7ba377709bfa7329"} Jul 13 19:35:27.642710 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.642672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsn25\" (UniqueName: \"kubernetes.io/projected/6edca6c4-f75e-4bbb-a47d-1fd34fc174bb-kube-api-access-qsn25\") pod \"kuadrant-operator-catalog-m92r6\" (UID: \"6edca6c4-f75e-4bbb-a47d-1fd34fc174bb\") " pod="kuadrant-system/kuadrant-operator-catalog-m92r6" Jul 13 19:35:27.650574 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.650538 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsn25\" (UniqueName: \"kubernetes.io/projected/6edca6c4-f75e-4bbb-a47d-1fd34fc174bb-kube-api-access-qsn25\") pod \"kuadrant-operator-catalog-m92r6\" (UID: \"6edca6c4-f75e-4bbb-a47d-1fd34fc174bb\") " pod="kuadrant-system/kuadrant-operator-catalog-m92r6" Jul 13 19:35:27.747334 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.746889 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m92r6" Jul 13 19:35:27.922785 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:27.922754 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m92r6"] Jul 13 19:35:27.926209 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:35:27.926185 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6edca6c4_f75e_4bbb_a47d_1fd34fc174bb.slice/crio-cdc0525dd1e37540eff1633428915cd70d5da6bed741f7dd2a27730b50789ddb WatchSource:0}: Error finding container cdc0525dd1e37540eff1633428915cd70d5da6bed741f7dd2a27730b50789ddb: Status 404 returned error can't find the container with id cdc0525dd1e37540eff1633428915cd70d5da6bed741f7dd2a27730b50789ddb Jul 13 19:35:28.595405 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:28.595369 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m92r6" event={"ID":"6edca6c4-f75e-4bbb-a47d-1fd34fc174bb","Type":"ContainerStarted","Data":"cdc0525dd1e37540eff1633428915cd70d5da6bed741f7dd2a27730b50789ddb"} Jul 13 19:35:29.493225 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:29.493190 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:35:29.493678 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:29.493462 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:35:30.604771 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:30.604728 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m92r6" event={"ID":"6edca6c4-f75e-4bbb-a47d-1fd34fc174bb","Type":"ContainerStarted","Data":"061edfe2cf1c4eb3a3246a9d751668f815d9ff836be8c17bdc977b1c92a77257"} Jul 13 19:35:30.607443 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:30.606173 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" event={"ID":"3e59f71c-d22f-422a-a037-b8af32dd806b","Type":"ContainerStarted","Data":"70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65"} Jul 13 19:35:30.607443 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:30.606238 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" podUID="3e59f71c-d22f-422a-a037-b8af32dd806b" containerName="registry-server" containerID="cri-o://70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65" gracePeriod=2 Jul 13 19:35:30.619394 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:30.619351 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m92r6" podStartSLOduration=2.003854402 podStartE2EDuration="3.619336516s" totalImagesPullingTime="1.615482114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:35:30.618905637 +0000 UTC m=+601.665459908" watchObservedRunningTime="2026-07-13 19:35:30.619336516 +0000 UTC m=+601.665890785" Jul 13 19:35:30.633417 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:30.633368 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" podStartSLOduration=2.399408209 podStartE2EDuration="4.633351179s" totalImagesPullingTime="2.23394297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:35:30.632445129 +0000 UTC m=+601.678999412" watchObservedRunningTime="2026-07-13 19:35:30.633351179 +0000 UTC m=+601.679905469" Jul 13 19:35:30.848699 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:30.848672 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" Jul 13 19:35:30.971601 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:30.971517 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxbsx\" (UniqueName: \"kubernetes.io/projected/3e59f71c-d22f-422a-a037-b8af32dd806b-kube-api-access-kxbsx\") pod \"3e59f71c-d22f-422a-a037-b8af32dd806b\" (UID: \"3e59f71c-d22f-422a-a037-b8af32dd806b\") " Jul 13 19:35:30.974032 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:30.974000 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e59f71c-d22f-422a-a037-b8af32dd806b-kube-api-access-kxbsx" (OuterVolumeSpecName: "kube-api-access-kxbsx") pod "3e59f71c-d22f-422a-a037-b8af32dd806b" (UID: "3e59f71c-d22f-422a-a037-b8af32dd806b"). InnerVolumeSpecName "kube-api-access-kxbsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:35:31.072561 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.072524 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxbsx\" (UniqueName: \"kubernetes.io/projected/3e59f71c-d22f-422a-a037-b8af32dd806b-kube-api-access-kxbsx\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:35:31.611936 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.611899 2555 generic.go:356] "Generic (PLEG): container finished" podID="3e59f71c-d22f-422a-a037-b8af32dd806b" containerID="70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65" exitCode=0 Jul 13 19:35:31.612431 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.611953 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" Jul 13 19:35:31.612431 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.612004 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" event={"ID":"3e59f71c-d22f-422a-a037-b8af32dd806b","Type":"ContainerDied","Data":"70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65"} Jul 13 19:35:31.612431 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.612091 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4l2m" event={"ID":"3e59f71c-d22f-422a-a037-b8af32dd806b","Type":"ContainerDied","Data":"cc0a6aec1344a6b2dd2d572e2e278b02b9e71f949f8fb76f7ba377709bfa7329"} Jul 13 19:35:31.612431 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.612125 2555 scope.go:117] "RemoveContainer" containerID="70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65" Jul 13 19:35:31.620473 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.620458 2555 scope.go:117] "RemoveContainer" containerID="70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65" Jul 13 19:35:31.620760 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:35:31.620739 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65\": container with ID starting with 70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65 not found: ID does not exist" containerID="70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65" Jul 13 19:35:31.620850 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.620765 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65"} err="failed to get container status \"70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65\": rpc error: code = NotFound desc = could not find container \"70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65\": container with ID starting with 70c1bf0f417e5e492029eaf2414664036c75465a7c3d4176bac7997f255d7f65 not found: ID does not exist" Jul 13 19:35:31.626610 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.626590 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4l2m"] Jul 13 19:35:31.630186 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:31.630167 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4l2m"] Jul 13 19:35:33.548816 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:33.548784 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e59f71c-d22f-422a-a037-b8af32dd806b" path="/var/lib/kubelet/pods/3e59f71c-d22f-422a-a037-b8af32dd806b/volumes" Jul 13 19:35:37.747749 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:37.747710 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-m92r6" Jul 13 19:35:37.748272 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:37.747784 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-m92r6" Jul 13 19:35:37.770745 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:37.770719 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-m92r6" Jul 13 19:35:38.662937 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:38.662910 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-m92r6" Jul 13 19:35:51.935187 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:51.935110 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:51.985962 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:51.985924 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:55.031675 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:55.031637 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:55.413500 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:55.413462 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:55.498105 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:55.498067 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:55.640960 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:55.640929 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:56.659657 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:56.659623 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:59.470495 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:59.470458 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:35:59.572228 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:35:59.572198 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:00.060271 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:00.060239 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:01.912312 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:01.912273 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2"] Jul 13 19:36:01.912672 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:01.912551 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e59f71c-d22f-422a-a037-b8af32dd806b" containerName="registry-server" Jul 13 19:36:01.912672 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:01.912562 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e59f71c-d22f-422a-a037-b8af32dd806b" containerName="registry-server" Jul 13 19:36:01.912672 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:01.912607 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e59f71c-d22f-422a-a037-b8af32dd806b" containerName="registry-server" Jul 13 19:36:01.916930 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:01.916910 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" Jul 13 19:36:01.919517 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:01.919492 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vrb6g\"" Jul 13 19:36:01.919652 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:01.919505 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 13 19:36:01.928135 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:01.928109 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2"] Jul 13 19:36:02.028777 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:02.028739 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bmfb\" (UniqueName: \"kubernetes.io/projected/b9aa4949-c632-478b-8b0a-655d7e3ff9f6-kube-api-access-7bmfb\") pod \"dns-operator-controller-manager-864dd78c4c-d4cq2\" (UID: \"b9aa4949-c632-478b-8b0a-655d7e3ff9f6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" Jul 13 19:36:02.129952 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:02.129915 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bmfb\" (UniqueName: \"kubernetes.io/projected/b9aa4949-c632-478b-8b0a-655d7e3ff9f6-kube-api-access-7bmfb\") pod \"dns-operator-controller-manager-864dd78c4c-d4cq2\" (UID: \"b9aa4949-c632-478b-8b0a-655d7e3ff9f6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" Jul 13 19:36:02.138487 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:02.138455 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bmfb\" (UniqueName: \"kubernetes.io/projected/b9aa4949-c632-478b-8b0a-655d7e3ff9f6-kube-api-access-7bmfb\") pod \"dns-operator-controller-manager-864dd78c4c-d4cq2\" (UID: \"b9aa4949-c632-478b-8b0a-655d7e3ff9f6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" Jul 13 19:36:02.226582 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:02.226498 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" Jul 13 19:36:02.362813 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:02.362780 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2"] Jul 13 19:36:02.365802 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:36:02.365775 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9aa4949_c632_478b_8b0a_655d7e3ff9f6.slice/crio-aa8cd7b350ac2c2b3b21d16c1113472c795b86ffdcc530b2dbe3bd1ee03a1d8b WatchSource:0}: Error finding container aa8cd7b350ac2c2b3b21d16c1113472c795b86ffdcc530b2dbe3bd1ee03a1d8b: Status 404 returned error can't find the container with id aa8cd7b350ac2c2b3b21d16c1113472c795b86ffdcc530b2dbe3bd1ee03a1d8b Jul 13 19:36:02.677728 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:02.677697 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:02.738559 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:02.738524 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" event={"ID":"b9aa4949-c632-478b-8b0a-655d7e3ff9f6","Type":"ContainerStarted","Data":"aa8cd7b350ac2c2b3b21d16c1113472c795b86ffdcc530b2dbe3bd1ee03a1d8b"} Jul 13 19:36:02.904322 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:02.904283 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:03.894118 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:03.894081 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:05.754438 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:05.754400 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" event={"ID":"b9aa4949-c632-478b-8b0a-655d7e3ff9f6","Type":"ContainerStarted","Data":"0986d8c25cd9d30634ad8480b03ed86414c5a922fb2dc88c57f3cd6d51c24ec4"} Jul 13 19:36:05.754854 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:05.754495 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" Jul 13 19:36:05.773931 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:05.773862 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" podStartSLOduration=2.168152978 podStartE2EDuration="4.773839934s" totalImagesPullingTime="2.605686956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:36:05.771396249 +0000 UTC m=+636.817950532" watchObservedRunningTime="2026-07-13 19:36:05.773839934 +0000 UTC m=+636.820394205" Jul 13 19:36:06.133106 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.133061 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n"] Jul 13 19:36:06.136404 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.136382 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:06.139407 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.139385 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vscnb\"" Jul 13 19:36:06.151338 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.151314 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n"] Jul 13 19:36:06.162278 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.162254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktmxc\" (UniqueName: \"kubernetes.io/projected/4632954c-e9aa-41c1-afa3-3af2b771ca76-kube-api-access-ktmxc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74n6n\" (UID: \"4632954c-e9aa-41c1-afa3-3af2b771ca76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:06.162406 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.162303 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4632954c-e9aa-41c1-afa3-3af2b771ca76-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74n6n\" (UID: \"4632954c-e9aa-41c1-afa3-3af2b771ca76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:06.263385 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.263347 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4632954c-e9aa-41c1-afa3-3af2b771ca76-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74n6n\" (UID: \"4632954c-e9aa-41c1-afa3-3af2b771ca76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:06.263585 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.263450 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktmxc\" (UniqueName: \"kubernetes.io/projected/4632954c-e9aa-41c1-afa3-3af2b771ca76-kube-api-access-ktmxc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74n6n\" (UID: \"4632954c-e9aa-41c1-afa3-3af2b771ca76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:06.263761 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.263739 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4632954c-e9aa-41c1-afa3-3af2b771ca76-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74n6n\" (UID: \"4632954c-e9aa-41c1-afa3-3af2b771ca76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:06.272064 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.272042 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktmxc\" (UniqueName: \"kubernetes.io/projected/4632954c-e9aa-41c1-afa3-3af2b771ca76-kube-api-access-ktmxc\") pod \"kuadrant-operator-controller-manager-8684c9ff49-74n6n\" (UID: \"4632954c-e9aa-41c1-afa3-3af2b771ca76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:06.446194 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.446097 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:06.590044 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.590011 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n"] Jul 13 19:36:06.594251 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:36:06.594206 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4632954c_e9aa_41c1_afa3_3af2b771ca76.slice/crio-cad7d730b1904653ab353cf94425bbc82aac883ab52e56ce5c20ee9313425ad6 WatchSource:0}: Error finding container cad7d730b1904653ab353cf94425bbc82aac883ab52e56ce5c20ee9313425ad6: Status 404 returned error can't find the container with id cad7d730b1904653ab353cf94425bbc82aac883ab52e56ce5c20ee9313425ad6 Jul 13 19:36:06.662839 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.662805 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:06.760010 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.759892 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" event={"ID":"4632954c-e9aa-41c1-afa3-3af2b771ca76","Type":"ContainerStarted","Data":"cad7d730b1904653ab353cf94425bbc82aac883ab52e56ce5c20ee9313425ad6"} Jul 13 19:36:06.761857 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:06.761833 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:08.184538 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:08.184502 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:08.300076 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:08.300040 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:09.654054 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:09.654020 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:09.754364 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:09.754327 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:10.049045 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:10.048956 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:10.111700 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:10.111655 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:13.851407 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:13.851370 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:13.966258 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:13.966228 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:14.796931 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:14.796885 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" event={"ID":"4632954c-e9aa-41c1-afa3-3af2b771ca76","Type":"ContainerStarted","Data":"5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754"} Jul 13 19:36:14.797157 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:14.797079 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:14.817741 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:14.817678 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" podStartSLOduration=1.157249778 podStartE2EDuration="8.817657752s" totalImagesPullingTime="7.660407974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:36:14.815863484 +0000 UTC m=+645.862417780" watchObservedRunningTime="2026-07-13 19:36:14.817657752 +0000 UTC m=+645.864212028" Jul 13 19:36:16.762919 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:16.762882 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-d4cq2" Jul 13 19:36:17.049738 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:17.049698 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:17.173249 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:17.173208 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:19.241193 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:19.241163 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:19.297165 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:19.297134 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:20.391125 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:20.391090 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:20.488918 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:20.488876 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:25.060015 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:25.059956 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:25.485755 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:25.485669 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:25.586501 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:25.586467 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:25.803629 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:25.803600 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:26.648204 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.648171 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8"] Jul 13 19:36:26.651486 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.651469 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:26.667292 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.667263 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8"] Jul 13 19:36:26.715618 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.715580 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" (UID: \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:26.715618 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.715628 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxlq\" (UniqueName: \"kubernetes.io/projected/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-kube-api-access-hjxlq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" (UID: \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:26.816047 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.816010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" (UID: \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:26.816229 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.816063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxlq\" (UniqueName: \"kubernetes.io/projected/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-kube-api-access-hjxlq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" (UID: \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:26.816374 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.816353 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" (UID: \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:26.824475 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.824447 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxlq\" (UniqueName: \"kubernetes.io/projected/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-kube-api-access-hjxlq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" (UID: \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:26.961682 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:26.961591 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:27.094724 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.094657 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8"] Jul 13 19:36:27.097366 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:36:27.097342 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8906d8a4_75c9_4e5c_8b9e_dce0d3ae96ba.slice/crio-56fd187307e70a58be1803ec432445a54fc6981af443de7657ad01543a987371 WatchSource:0}: Error finding container 56fd187307e70a58be1803ec432445a54fc6981af443de7657ad01543a987371: Status 404 returned error can't find the container with id 56fd187307e70a58be1803ec432445a54fc6981af443de7657ad01543a987371 Jul 13 19:36:27.494297 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.494260 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8"] Jul 13 19:36:27.498576 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.498547 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8"] Jul 13 19:36:27.512179 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.512140 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n"] Jul 13 19:36:27.512383 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.512332 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" podUID="4632954c-e9aa-41c1-afa3-3af2b771ca76" containerName="manager" containerID="cri-o://5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754" gracePeriod=2 Jul 13 19:36:27.516911 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.516883 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds"] Jul 13 19:36:27.517321 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.517303 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" containerName="manager" Jul 13 19:36:27.517380 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.517326 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" containerName="manager" Jul 13 19:36:27.517455 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.517442 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" containerName="manager" Jul 13 19:36:27.521478 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.521406 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:27.523147 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.523069 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n"] Jul 13 19:36:27.527965 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:27.527892 2555 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4632954c-e9aa-41c1-afa3-3af2b771ca76\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-74n6n\": pods \"kuadrant-operator-controller-manager-8684c9ff49-74n6n\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:27.534601 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.534579 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds"] Jul 13 19:36:27.537759 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.537740 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6"] Jul 13 19:36:27.538180 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.538051 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4632954c-e9aa-41c1-afa3-3af2b771ca76" containerName="manager" Jul 13 19:36:27.538180 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.538069 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4632954c-e9aa-41c1-afa3-3af2b771ca76" containerName="manager" Jul 13 19:36:27.538180 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.538154 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4632954c-e9aa-41c1-afa3-3af2b771ca76" containerName="manager" Jul 13 19:36:27.540879 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.540862 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:27.559848 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:27.559691 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-74n6n\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="4632954c-e9aa-41c1-afa3-3af2b771ca76" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:27.562774 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.562747 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6"] Jul 13 19:36:27.621110 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.621079 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssfn4\" (UniqueName: \"kubernetes.io/projected/da4478bb-d93d-48d4-b4f9-a324b197e0cf-kube-api-access-ssfn4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss8ds\" (UID: \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:27.621268 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.621127 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvk6j\" (UniqueName: \"kubernetes.io/projected/6af12381-33f1-4289-9ca1-40ff0351e641-kube-api-access-vvk6j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r52w6\" (UID: \"6af12381-33f1-4289-9ca1-40ff0351e641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:27.621497 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.621355 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6af12381-33f1-4289-9ca1-40ff0351e641-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r52w6\" (UID: \"6af12381-33f1-4289-9ca1-40ff0351e641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:27.621539 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.621520 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4478bb-d93d-48d4-b4f9-a324b197e0cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss8ds\" (UID: \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:27.722671 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.722501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6af12381-33f1-4289-9ca1-40ff0351e641-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r52w6\" (UID: \"6af12381-33f1-4289-9ca1-40ff0351e641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:27.722671 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.722550 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4478bb-d93d-48d4-b4f9-a324b197e0cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss8ds\" (UID: \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:27.723184 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.722962 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4478bb-d93d-48d4-b4f9-a324b197e0cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss8ds\" (UID: \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:27.723184 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.723098 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssfn4\" (UniqueName: \"kubernetes.io/projected/da4478bb-d93d-48d4-b4f9-a324b197e0cf-kube-api-access-ssfn4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss8ds\" (UID: \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:27.723184 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.723163 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk6j\" (UniqueName: \"kubernetes.io/projected/6af12381-33f1-4289-9ca1-40ff0351e641-kube-api-access-vvk6j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r52w6\" (UID: \"6af12381-33f1-4289-9ca1-40ff0351e641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:27.723825 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.723803 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6af12381-33f1-4289-9ca1-40ff0351e641-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r52w6\" (UID: \"6af12381-33f1-4289-9ca1-40ff0351e641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:27.736416 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.736388 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssfn4\" (UniqueName: \"kubernetes.io/projected/da4478bb-d93d-48d4-b4f9-a324b197e0cf-kube-api-access-ssfn4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ss8ds\" (UID: \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:27.736542 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.736470 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvk6j\" (UniqueName: \"kubernetes.io/projected/6af12381-33f1-4289-9ca1-40ff0351e641-kube-api-access-vvk6j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r52w6\" (UID: \"6af12381-33f1-4289-9ca1-40ff0351e641\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:27.747445 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.747382 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:27.825006 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.824535 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktmxc\" (UniqueName: \"kubernetes.io/projected/4632954c-e9aa-41c1-afa3-3af2b771ca76-kube-api-access-ktmxc\") pod \"4632954c-e9aa-41c1-afa3-3af2b771ca76\" (UID: \"4632954c-e9aa-41c1-afa3-3af2b771ca76\") " Jul 13 19:36:27.825006 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.824640 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4632954c-e9aa-41c1-afa3-3af2b771ca76-extensions-socket-volume\") pod \"4632954c-e9aa-41c1-afa3-3af2b771ca76\" (UID: \"4632954c-e9aa-41c1-afa3-3af2b771ca76\") " Jul 13 19:36:27.825365 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.825332 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4632954c-e9aa-41c1-afa3-3af2b771ca76-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4632954c-e9aa-41c1-afa3-3af2b771ca76" (UID: "4632954c-e9aa-41c1-afa3-3af2b771ca76"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:36:27.827075 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.827053 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4632954c-e9aa-41c1-afa3-3af2b771ca76-kube-api-access-ktmxc" (OuterVolumeSpecName: "kube-api-access-ktmxc") pod "4632954c-e9aa-41c1-afa3-3af2b771ca76" (UID: "4632954c-e9aa-41c1-afa3-3af2b771ca76"). InnerVolumeSpecName "kube-api-access-ktmxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:36:27.857134 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.857106 2555 generic.go:356] "Generic (PLEG): container finished" podID="4632954c-e9aa-41c1-afa3-3af2b771ca76" containerID="5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754" exitCode=0 Jul 13 19:36:27.857223 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.857153 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-74n6n" Jul 13 19:36:27.857223 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.857209 2555 scope.go:117] "RemoveContainer" containerID="5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754" Jul 13 19:36:27.859107 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:27.859091 2555 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" container="manager" Jul 13 19:36:27.866484 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.866463 2555 scope.go:117] "RemoveContainer" containerID="5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754" Jul 13 19:36:27.866708 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:27.866690 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754\": container with ID starting with 5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754 not found: ID does not exist" containerID="5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754" Jul 13 19:36:27.866774 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.866716 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754"} err="failed to get container status \"5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754\": rpc error: code = NotFound desc = could not find container \"5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754\": container with ID starting with 5a599bc5d0d9ec1a8095d621f71ab4e74ed26c67aad04eb9f16c75a5090ee754 not found: ID does not exist" Jul 13 19:36:27.879144 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.879122 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:27.886911 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.886890 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:27.925713 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.925675 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktmxc\" (UniqueName: \"kubernetes.io/projected/4632954c-e9aa-41c1-afa3-3af2b771ca76-kube-api-access-ktmxc\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:36:27.925713 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:27.925706 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4632954c-e9aa-41c1-afa3-3af2b771ca76-extensions-socket-volume\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:36:28.033367 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.033295 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds"] Jul 13 19:36:28.036724 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:36:28.036697 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4478bb_d93d_48d4_b4f9_a324b197e0cf.slice/crio-a3088b369c016e3bdd12626ff204905bed4b003a3f4747e7e4d9949cf81df08c WatchSource:0}: Error finding container a3088b369c016e3bdd12626ff204905bed4b003a3f4747e7e4d9949cf81df08c: Status 404 returned error can't find the container with id a3088b369c016e3bdd12626ff204905bed4b003a3f4747e7e4d9949cf81df08c Jul 13 19:36:28.054719 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.054692 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6"] Jul 13 19:36:28.058136 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:36:28.058111 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af12381_33f1_4289_9ca1_40ff0351e641.slice/crio-0e26757d2ad8897fbae4f5de62c88a59e759f58bc433923c80737cb15b9b84a6 WatchSource:0}: Error finding container 0e26757d2ad8897fbae4f5de62c88a59e759f58bc433923c80737cb15b9b84a6: Status 404 returned error can't find the container with id 0e26757d2ad8897fbae4f5de62c88a59e759f58bc433923c80737cb15b9b84a6 Jul 13 19:36:28.865119 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.865077 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" containerName="manager" containerID="cri-o://7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791" gracePeriod=2 Jul 13 19:36:28.866717 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.866682 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" event={"ID":"da4478bb-d93d-48d4-b4f9-a324b197e0cf","Type":"ContainerStarted","Data":"2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b"} Jul 13 19:36:28.866858 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.866768 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:28.866858 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.866793 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" event={"ID":"da4478bb-d93d-48d4-b4f9-a324b197e0cf","Type":"ContainerStarted","Data":"a3088b369c016e3bdd12626ff204905bed4b003a3f4747e7e4d9949cf81df08c"} Jul 13 19:36:28.867481 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:28.867440 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:28.868560 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.868539 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" event={"ID":"6af12381-33f1-4289-9ca1-40ff0351e641","Type":"ContainerStarted","Data":"1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080"} Jul 13 19:36:28.868662 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.868579 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" event={"ID":"6af12381-33f1-4289-9ca1-40ff0351e641","Type":"ContainerStarted","Data":"0e26757d2ad8897fbae4f5de62c88a59e759f58bc433923c80737cb15b9b84a6"} Jul 13 19:36:28.868662 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.868599 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:28.869423 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:28.869393 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:28.895550 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.895507 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" podStartSLOduration=1.895492565 podStartE2EDuration="1.895492565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:36:28.894363502 +0000 UTC m=+659.940917808" watchObservedRunningTime="2026-07-13 19:36:28.895492565 +0000 UTC m=+659.942046834" Jul 13 19:36:28.917533 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:28.917486 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" podStartSLOduration=1.917471141 podStartE2EDuration="1.917471141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:36:28.916799973 +0000 UTC m=+659.963354276" watchObservedRunningTime="2026-07-13 19:36:28.917471141 +0000 UTC m=+659.964025411" Jul 13 19:36:28.919039 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:28.919014 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:29.110495 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.110470 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:29.120423 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:29.120362 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:29.143733 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.143693 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjxlq\" (UniqueName: \"kubernetes.io/projected/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-kube-api-access-hjxlq\") pod \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\" (UID: \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\") " Jul 13 19:36:29.143933 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.143765 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-extensions-socket-volume\") pod \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\" (UID: \"8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba\") " Jul 13 19:36:29.144169 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.144138 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" (UID: "8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:36:29.145926 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.145903 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-kube-api-access-hjxlq" (OuterVolumeSpecName: "kube-api-access-hjxlq") pod "8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" (UID: "8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba"). InnerVolumeSpecName "kube-api-access-hjxlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:36:29.245261 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.245225 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjxlq\" (UniqueName: \"kubernetes.io/projected/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-kube-api-access-hjxlq\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:36:29.245261 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.245255 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba-extensions-socket-volume\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:36:29.502770 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.502732 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:29.547844 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:29.547808 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:29.550032 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.550010 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4632954c-e9aa-41c1-afa3-3af2b771ca76" path="/var/lib/kubelet/pods/4632954c-e9aa-41c1-afa3-3af2b771ca76/volumes" Jul 13 19:36:29.550360 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.550348 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" path="/var/lib/kubelet/pods/8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba/volumes" Jul 13 19:36:29.603586 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.603557 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:29.875522 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.875492 2555 generic.go:356] "Generic (PLEG): container finished" podID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" containerID="7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791" exitCode=0 Jul 13 19:36:29.876002 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.875536 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:29.876002 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.875589 2555 scope.go:117] "RemoveContainer" containerID="7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791" Jul 13 19:36:29.880120 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:29.880095 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pbcn8\" is forbidden: User \"system:node:ip-10-0-134-100.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-100.ec2.internal' and this object" podUID="8906d8a4-75c9-4e5c-8b9e-dce0d3ae96ba" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pbcn8" Jul 13 19:36:29.885447 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.885417 2555 scope.go:117] "RemoveContainer" containerID="7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791" Jul 13 19:36:29.885861 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:29.885842 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791\": container with ID starting with 7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791 not found: ID does not exist" containerID="7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791" Jul 13 19:36:29.885939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:29.885871 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791"} err="failed to get container status \"7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791\": rpc error: code = NotFound desc = could not find container \"7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791\": container with ID starting with 7c1d2e0da395fb12aee04c9548002ae2ee2284e79bd6e787650b7fba254bf791 not found: ID does not exist" Jul 13 19:36:30.087788 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:30.087752 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:30.189197 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:30.189119 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:33.090246 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:33.090190 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:33.156143 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:33.156113 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:37.489961 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:37.489927 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:37.548305 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:37.548280 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:39.877485 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:39.877445 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:39.877847 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:39.877549 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:39.954148 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:39.954115 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6"] Jul 13 19:36:39.954400 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:39.954376 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" podUID="6af12381-33f1-4289-9ca1-40ff0351e641" containerName="manager" containerID="cri-o://1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080" gracePeriod=10 Jul 13 19:36:40.150397 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.150328 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9"] Jul 13 19:36:40.154106 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.154085 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:40.173541 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.173511 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9"] Jul 13 19:36:40.208365 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.208344 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:40.240462 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.240430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv5jc\" (UniqueName: \"kubernetes.io/projected/6fe828e0-03b6-41c3-aacb-8e4902093b8e-kube-api-access-pv5jc\") pod \"kuadrant-operator-controller-manager-86878c769f-dv9q9\" (UID: \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:40.240639 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.240495 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fe828e0-03b6-41c3-aacb-8e4902093b8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dv9q9\" (UID: \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:40.341768 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.341741 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvk6j\" (UniqueName: \"kubernetes.io/projected/6af12381-33f1-4289-9ca1-40ff0351e641-kube-api-access-vvk6j\") pod \"6af12381-33f1-4289-9ca1-40ff0351e641\" (UID: \"6af12381-33f1-4289-9ca1-40ff0351e641\") " Jul 13 19:36:40.341939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.341822 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6af12381-33f1-4289-9ca1-40ff0351e641-extensions-socket-volume\") pod \"6af12381-33f1-4289-9ca1-40ff0351e641\" (UID: \"6af12381-33f1-4289-9ca1-40ff0351e641\") " Jul 13 19:36:40.341939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.341929 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5jc\" (UniqueName: \"kubernetes.io/projected/6fe828e0-03b6-41c3-aacb-8e4902093b8e-kube-api-access-pv5jc\") pod \"kuadrant-operator-controller-manager-86878c769f-dv9q9\" (UID: \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:40.342061 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.341968 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fe828e0-03b6-41c3-aacb-8e4902093b8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dv9q9\" (UID: \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:40.342230 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.342208 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af12381-33f1-4289-9ca1-40ff0351e641-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6af12381-33f1-4289-9ca1-40ff0351e641" (UID: "6af12381-33f1-4289-9ca1-40ff0351e641"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:36:40.342442 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.342427 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fe828e0-03b6-41c3-aacb-8e4902093b8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dv9q9\" (UID: \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:40.344008 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.343969 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af12381-33f1-4289-9ca1-40ff0351e641-kube-api-access-vvk6j" (OuterVolumeSpecName: "kube-api-access-vvk6j") pod "6af12381-33f1-4289-9ca1-40ff0351e641" (UID: "6af12381-33f1-4289-9ca1-40ff0351e641"). InnerVolumeSpecName "kube-api-access-vvk6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:36:40.353799 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.353767 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv5jc\" (UniqueName: \"kubernetes.io/projected/6fe828e0-03b6-41c3-aacb-8e4902093b8e-kube-api-access-pv5jc\") pod \"kuadrant-operator-controller-manager-86878c769f-dv9q9\" (UID: \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:40.442704 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.442626 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvk6j\" (UniqueName: \"kubernetes.io/projected/6af12381-33f1-4289-9ca1-40ff0351e641-kube-api-access-vvk6j\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:36:40.442704 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.442653 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6af12381-33f1-4289-9ca1-40ff0351e641-extensions-socket-volume\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:36:40.463658 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.463627 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:40.603011 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.602964 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9"] Jul 13 19:36:40.605854 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:36:40.605826 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe828e0_03b6_41c3_aacb_8e4902093b8e.slice/crio-70a50379f233a9e75ccabd6f62130cc17a27b4dfd107419fa7fe792588132145 WatchSource:0}: Error finding container 70a50379f233a9e75ccabd6f62130cc17a27b4dfd107419fa7fe792588132145: Status 404 returned error can't find the container with id 70a50379f233a9e75ccabd6f62130cc17a27b4dfd107419fa7fe792588132145 Jul 13 19:36:40.925173 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.925139 2555 generic.go:356] "Generic (PLEG): container finished" podID="6af12381-33f1-4289-9ca1-40ff0351e641" containerID="1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080" exitCode=0 Jul 13 19:36:40.925652 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.925183 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" event={"ID":"6af12381-33f1-4289-9ca1-40ff0351e641","Type":"ContainerDied","Data":"1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080"} Jul 13 19:36:40.925652 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.925206 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" Jul 13 19:36:40.925652 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.925251 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6" event={"ID":"6af12381-33f1-4289-9ca1-40ff0351e641","Type":"ContainerDied","Data":"0e26757d2ad8897fbae4f5de62c88a59e759f58bc433923c80737cb15b9b84a6"} Jul 13 19:36:40.925652 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.925285 2555 scope.go:117] "RemoveContainer" containerID="1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080" Jul 13 19:36:40.927293 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.927208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" event={"ID":"6fe828e0-03b6-41c3-aacb-8e4902093b8e","Type":"ContainerStarted","Data":"2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e"} Jul 13 19:36:40.927293 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.927257 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" event={"ID":"6fe828e0-03b6-41c3-aacb-8e4902093b8e","Type":"ContainerStarted","Data":"70a50379f233a9e75ccabd6f62130cc17a27b4dfd107419fa7fe792588132145"} Jul 13 19:36:40.927477 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.927378 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:40.937924 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.937906 2555 scope.go:117] "RemoveContainer" containerID="1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080" Jul 13 19:36:40.938255 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:40.938236 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080\": container with ID starting with 1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080 not found: ID does not exist" containerID="1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080" Jul 13 19:36:40.938321 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.938264 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080"} err="failed to get container status \"1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080\": rpc error: code = NotFound desc = could not find container \"1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080\": container with ID starting with 1c958026fff320457917a094790639e320bc45b20f4e35ebfa0b21b89b77d080 not found: ID does not exist" Jul 13 19:36:40.952256 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.952217 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" podStartSLOduration=0.952204253 podStartE2EDuration="952.204253ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:36:40.950677805 +0000 UTC m=+671.997232076" watchObservedRunningTime="2026-07-13 19:36:40.952204253 +0000 UTC m=+671.998758523" Jul 13 19:36:40.966135 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.966109 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6"] Jul 13 19:36:40.972276 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:40.972246 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r52w6"] Jul 13 19:36:41.550222 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:41.550181 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6af12381-33f1-4289-9ca1-40ff0351e641" path="/var/lib/kubelet/pods/6af12381-33f1-4289-9ca1-40ff0351e641/volumes" Jul 13 19:36:44.274569 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:44.274530 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:44.375386 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:44.375341 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:51.934868 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:51.934839 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:36:51.986282 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:51.986254 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds"] Jul 13 19:36:51.986501 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:51.986473 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" podUID="da4478bb-d93d-48d4-b4f9-a324b197e0cf" containerName="manager" containerID="cri-o://2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b" gracePeriod=10 Jul 13 19:36:52.228273 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.228240 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:52.344702 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.344668 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4478bb-d93d-48d4-b4f9-a324b197e0cf-extensions-socket-volume\") pod \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\" (UID: \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\") " Jul 13 19:36:52.344862 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.344758 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssfn4\" (UniqueName: \"kubernetes.io/projected/da4478bb-d93d-48d4-b4f9-a324b197e0cf-kube-api-access-ssfn4\") pod \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\" (UID: \"da4478bb-d93d-48d4-b4f9-a324b197e0cf\") " Jul 13 19:36:52.345099 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.345071 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da4478bb-d93d-48d4-b4f9-a324b197e0cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "da4478bb-d93d-48d4-b4f9-a324b197e0cf" (UID: "da4478bb-d93d-48d4-b4f9-a324b197e0cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:36:52.346967 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.346935 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da4478bb-d93d-48d4-b4f9-a324b197e0cf-kube-api-access-ssfn4" (OuterVolumeSpecName: "kube-api-access-ssfn4") pod "da4478bb-d93d-48d4-b4f9-a324b197e0cf" (UID: "da4478bb-d93d-48d4-b4f9-a324b197e0cf"). InnerVolumeSpecName "kube-api-access-ssfn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:36:52.446009 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.445924 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssfn4\" (UniqueName: \"kubernetes.io/projected/da4478bb-d93d-48d4-b4f9-a324b197e0cf-kube-api-access-ssfn4\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:36:52.446009 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.445967 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da4478bb-d93d-48d4-b4f9-a324b197e0cf-extensions-socket-volume\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:36:52.981854 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.981820 2555 generic.go:356] "Generic (PLEG): container finished" podID="da4478bb-d93d-48d4-b4f9-a324b197e0cf" containerID="2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b" exitCode=0 Jul 13 19:36:52.982282 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.981861 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" Jul 13 19:36:52.982282 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.981903 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" event={"ID":"da4478bb-d93d-48d4-b4f9-a324b197e0cf","Type":"ContainerDied","Data":"2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b"} Jul 13 19:36:52.982282 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.981955 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds" event={"ID":"da4478bb-d93d-48d4-b4f9-a324b197e0cf","Type":"ContainerDied","Data":"a3088b369c016e3bdd12626ff204905bed4b003a3f4747e7e4d9949cf81df08c"} Jul 13 19:36:52.982282 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.981998 2555 scope.go:117] "RemoveContainer" containerID="2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b" Jul 13 19:36:52.990677 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.990534 2555 scope.go:117] "RemoveContainer" containerID="2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b" Jul 13 19:36:52.990855 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:36:52.990835 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b\": container with ID starting with 2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b not found: ID does not exist" containerID="2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b" Jul 13 19:36:52.990895 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:52.990865 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b"} err="failed to get container status \"2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b\": rpc error: code = NotFound desc = could not find container \"2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b\": container with ID starting with 2c3c8f7de8f7d49a2d15305399a99a8bf4fbeb60b2ccb12ac762e95046ff788b not found: ID does not exist" Jul 13 19:36:53.026691 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:53.026661 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds"] Jul 13 19:36:53.033480 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:53.033454 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ss8ds"] Jul 13 19:36:53.548899 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:53.548864 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da4478bb-d93d-48d4-b4f9-a324b197e0cf" path="/var/lib/kubelet/pods/da4478bb-d93d-48d4-b4f9-a324b197e0cf/volumes" Jul 13 19:36:54.329103 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:54.329078 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:56.304632 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.304605 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr"] Jul 13 19:36:56.305002 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.304876 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da4478bb-d93d-48d4-b4f9-a324b197e0cf" containerName="manager" Jul 13 19:36:56.305002 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.304885 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="da4478bb-d93d-48d4-b4f9-a324b197e0cf" containerName="manager" Jul 13 19:36:56.305002 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.304919 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af12381-33f1-4289-9ca1-40ff0351e641" containerName="manager" Jul 13 19:36:56.305002 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.304924 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af12381-33f1-4289-9ca1-40ff0351e641" containerName="manager" Jul 13 19:36:56.305138 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.305005 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="da4478bb-d93d-48d4-b4f9-a324b197e0cf" containerName="manager" Jul 13 19:36:56.305138 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.305015 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af12381-33f1-4289-9ca1-40ff0351e641" containerName="manager" Jul 13 19:36:56.309005 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.308964 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.311543 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.311522 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pb5t6\"" Jul 13 19:36:56.318567 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.318546 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr"] Jul 13 19:36:56.333161 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.333130 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:56.476737 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.476702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.476737 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.476741 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.476990 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.476760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea478e9b-3cbc-4909-bead-3f35b669a550-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.476990 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.476863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.476990 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.476893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.476990 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.476928 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.476990 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.476947 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.477161 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.477003 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88lb4\" (UniqueName: \"kubernetes.io/projected/ea478e9b-3cbc-4909-bead-3f35b669a550-kube-api-access-88lb4\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.477161 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.477035 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578396 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578312 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578396 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578353 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578396 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578380 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea478e9b-3cbc-4909-bead-3f35b669a550-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578682 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578428 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578682 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578682 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578490 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578682 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578682 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578550 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lb4\" (UniqueName: \"kubernetes.io/projected/ea478e9b-3cbc-4909-bead-3f35b669a550-kube-api-access-88lb4\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578682 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578585 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578972 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578903 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578972 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578933 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.578972 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.578956 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.579171 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.579023 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.579499 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.579475 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea478e9b-3cbc-4909-bead-3f35b669a550-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.580831 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.580805 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.580960 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.580944 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.586763 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.586738 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea478e9b-3cbc-4909-bead-3f35b669a550-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.587020 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.587002 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88lb4\" (UniqueName: \"kubernetes.io/projected/ea478e9b-3cbc-4909-bead-3f35b669a550-kube-api-access-88lb4\") pod \"maas-default-gateway-openshift-default-56654dcf7-dlgfr\" (UID: \"ea478e9b-3cbc-4909-bead-3f35b669a550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.619586 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.619550 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:56.766123 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.766089 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr"] Jul 13 19:36:56.768803 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:36:56.768775 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea478e9b_3cbc_4909_bead_3f35b669a550.slice/crio-7a79acbd04a59774375d22fc9800889bcb0d0bcf645334ba07607922a00510b7 WatchSource:0}: Error finding container 7a79acbd04a59774375d22fc9800889bcb0d0bcf645334ba07607922a00510b7: Status 404 returned error can't find the container with id 7a79acbd04a59774375d22fc9800889bcb0d0bcf645334ba07607922a00510b7 Jul 13 19:36:56.770765 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.770735 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:36:56.770848 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.770813 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:36:56.770909 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.770867 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:36:56.892521 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:56.892489 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:36:57.002654 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:57.002620 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" event={"ID":"ea478e9b-3cbc-4909-bead-3f35b669a550","Type":"ContainerStarted","Data":"2727379196e2252fc2b30053f3b856bd850a8b775fd4b4d8848dcfacc41e85e1"} Jul 13 19:36:57.002818 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:57.002698 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" event={"ID":"ea478e9b-3cbc-4909-bead-3f35b669a550","Type":"ContainerStarted","Data":"7a79acbd04a59774375d22fc9800889bcb0d0bcf645334ba07607922a00510b7"} Jul 13 19:36:57.022071 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:57.022021 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" podStartSLOduration=1.022001677 podStartE2EDuration="1.022001677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:36:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:36:57.021570203 +0000 UTC m=+688.068124497" watchObservedRunningTime="2026-07-13 19:36:57.022001677 +0000 UTC m=+688.068555947" Jul 13 19:36:57.620137 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:57.620105 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:57.625107 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:57.625081 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:58.006699 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:58.006619 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:36:58.007533 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:36:58.007511 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:37:00.176360 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:00.176321 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:10.169326 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.169284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:10.282963 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.282926 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:10.340284 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.340242 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:10.624969 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.624937 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:37:10.628522 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.628492 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:10.631214 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.631189 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 19:37:10.631335 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.631222 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vgxbs\"" Jul 13 19:37:10.638558 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.638533 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:37:10.669178 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.669145 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:37:10.698030 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.697991 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj9fz\" (UniqueName: \"kubernetes.io/projected/c8b7216d-9442-4f90-9b57-99bf03de6613-kube-api-access-lj9fz\") pod \"limitador-limitador-54d6d988d5-hfgh4\" (UID: \"c8b7216d-9442-4f90-9b57-99bf03de6613\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:10.698180 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.698086 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c8b7216d-9442-4f90-9b57-99bf03de6613-config-file\") pod \"limitador-limitador-54d6d988d5-hfgh4\" (UID: \"c8b7216d-9442-4f90-9b57-99bf03de6613\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:10.798701 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.798663 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj9fz\" (UniqueName: \"kubernetes.io/projected/c8b7216d-9442-4f90-9b57-99bf03de6613-kube-api-access-lj9fz\") pod \"limitador-limitador-54d6d988d5-hfgh4\" (UID: \"c8b7216d-9442-4f90-9b57-99bf03de6613\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:10.798859 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.798713 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c8b7216d-9442-4f90-9b57-99bf03de6613-config-file\") pod \"limitador-limitador-54d6d988d5-hfgh4\" (UID: \"c8b7216d-9442-4f90-9b57-99bf03de6613\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:10.799317 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.799300 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c8b7216d-9442-4f90-9b57-99bf03de6613-config-file\") pod \"limitador-limitador-54d6d988d5-hfgh4\" (UID: \"c8b7216d-9442-4f90-9b57-99bf03de6613\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:10.806927 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.806899 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj9fz\" (UniqueName: \"kubernetes.io/projected/c8b7216d-9442-4f90-9b57-99bf03de6613-kube-api-access-lj9fz\") pod \"limitador-limitador-54d6d988d5-hfgh4\" (UID: \"c8b7216d-9442-4f90-9b57-99bf03de6613\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:10.940168 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.940079 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:10.977885 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.977851 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-dfccx"] Jul 13 19:37:10.981405 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.981380 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dfccx" Jul 13 19:37:10.984060 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.983958 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kqs99\"" Jul 13 19:37:10.990731 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.990707 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dfccx"] Jul 13 19:37:10.999632 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:10.999465 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gms4\" (UniqueName: \"kubernetes.io/projected/ef27c593-5745-45ee-88ed-b6d7a530ca17-kube-api-access-4gms4\") pod \"authorino-58cd955675-dfccx\" (UID: \"ef27c593-5745-45ee-88ed-b6d7a530ca17\") " pod="kuadrant-system/authorino-58cd955675-dfccx" Jul 13 19:37:11.011763 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:11.011661 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:11.079195 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:11.079162 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:11.079486 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:11.079464 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:37:11.082345 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:37:11.082319 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b7216d_9442_4f90_9b57_99bf03de6613.slice/crio-5621f24d96e08e747a9e3075cd0f5915c4fe6975f6b6b7b8805e4a0d4e613ab9 WatchSource:0}: Error finding container 5621f24d96e08e747a9e3075cd0f5915c4fe6975f6b6b7b8805e4a0d4e613ab9: Status 404 returned error can't find the container with id 5621f24d96e08e747a9e3075cd0f5915c4fe6975f6b6b7b8805e4a0d4e613ab9 Jul 13 19:37:11.084313 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:11.084297 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 19:37:11.100243 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:11.100203 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gms4\" (UniqueName: \"kubernetes.io/projected/ef27c593-5745-45ee-88ed-b6d7a530ca17-kube-api-access-4gms4\") pod \"authorino-58cd955675-dfccx\" (UID: \"ef27c593-5745-45ee-88ed-b6d7a530ca17\") " pod="kuadrant-system/authorino-58cd955675-dfccx" Jul 13 19:37:11.108432 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:11.108399 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gms4\" (UniqueName: \"kubernetes.io/projected/ef27c593-5745-45ee-88ed-b6d7a530ca17-kube-api-access-4gms4\") pod \"authorino-58cd955675-dfccx\" (UID: \"ef27c593-5745-45ee-88ed-b6d7a530ca17\") " pod="kuadrant-system/authorino-58cd955675-dfccx" Jul 13 19:37:11.293450 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:11.293366 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dfccx" Jul 13 19:37:11.427757 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:11.427732 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dfccx"] Jul 13 19:37:11.430452 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:37:11.430424 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef27c593_5745_45ee_88ed_b6d7a530ca17.slice/crio-ece66c1328f175c1919af65f02a39fb62ee76e97ce5e0e6b257117cddadf6529 WatchSource:0}: Error finding container ece66c1328f175c1919af65f02a39fb62ee76e97ce5e0e6b257117cddadf6529: Status 404 returned error can't find the container with id ece66c1328f175c1919af65f02a39fb62ee76e97ce5e0e6b257117cddadf6529 Jul 13 19:37:12.071869 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:12.071831 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" event={"ID":"c8b7216d-9442-4f90-9b57-99bf03de6613","Type":"ContainerStarted","Data":"5621f24d96e08e747a9e3075cd0f5915c4fe6975f6b6b7b8805e4a0d4e613ab9"} Jul 13 19:37:12.073105 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:12.073077 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dfccx" event={"ID":"ef27c593-5745-45ee-88ed-b6d7a530ca17","Type":"ContainerStarted","Data":"ece66c1328f175c1919af65f02a39fb62ee76e97ce5e0e6b257117cddadf6529"} Jul 13 19:37:14.087434 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:14.087102 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" event={"ID":"c8b7216d-9442-4f90-9b57-99bf03de6613","Type":"ContainerStarted","Data":"77fbeecc49a8ca9e1c1a7c46e842a66dade201f929dca9c930f724a2b2c26181"} Jul 13 19:37:14.087434 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:14.087258 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:14.103555 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:14.103500 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" podStartSLOduration=1.587434348 podStartE2EDuration="4.103484737s" totalImagesPullingTime="2.516050389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:37:14.102864784 +0000 UTC m=+705.149419077" watchObservedRunningTime="2026-07-13 19:37:14.103484737 +0000 UTC m=+705.150039200" Jul 13 19:37:16.099347 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:16.099311 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dfccx" event={"ID":"ef27c593-5745-45ee-88ed-b6d7a530ca17","Type":"ContainerStarted","Data":"a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80"} Jul 13 19:37:16.114375 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:16.114296 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-dfccx" podStartSLOduration=1.765858937 podStartE2EDuration="6.114279308s" totalImagesPullingTime="4.348420371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:37:16.113740042 +0000 UTC m=+707.160294311" watchObservedRunningTime="2026-07-13 19:37:16.114279308 +0000 UTC m=+707.160833578" Jul 13 19:37:16.389637 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:16.389534 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dfccx"] Jul 13 19:37:18.108634 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:18.108555 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-dfccx" podUID="ef27c593-5745-45ee-88ed-b6d7a530ca17" containerName="authorino" containerID="cri-o://a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80" gracePeriod=30 Jul 13 19:37:18.356195 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:18.356169 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dfccx" Jul 13 19:37:18.465123 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:18.465031 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gms4\" (UniqueName: \"kubernetes.io/projected/ef27c593-5745-45ee-88ed-b6d7a530ca17-kube-api-access-4gms4\") pod \"ef27c593-5745-45ee-88ed-b6d7a530ca17\" (UID: \"ef27c593-5745-45ee-88ed-b6d7a530ca17\") " Jul 13 19:37:18.467237 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:18.467214 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef27c593-5745-45ee-88ed-b6d7a530ca17-kube-api-access-4gms4" (OuterVolumeSpecName: "kube-api-access-4gms4") pod "ef27c593-5745-45ee-88ed-b6d7a530ca17" (UID: "ef27c593-5745-45ee-88ed-b6d7a530ca17"). InnerVolumeSpecName "kube-api-access-4gms4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:37:18.565942 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:18.565903 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gms4\" (UniqueName: \"kubernetes.io/projected/ef27c593-5745-45ee-88ed-b6d7a530ca17-kube-api-access-4gms4\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:37:19.113994 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.113942 2555 generic.go:356] "Generic (PLEG): container finished" podID="ef27c593-5745-45ee-88ed-b6d7a530ca17" containerID="a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80" exitCode=0 Jul 13 19:37:19.114412 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.114013 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dfccx" Jul 13 19:37:19.114412 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.114019 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dfccx" event={"ID":"ef27c593-5745-45ee-88ed-b6d7a530ca17","Type":"ContainerDied","Data":"a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80"} Jul 13 19:37:19.114412 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.114070 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dfccx" event={"ID":"ef27c593-5745-45ee-88ed-b6d7a530ca17","Type":"ContainerDied","Data":"ece66c1328f175c1919af65f02a39fb62ee76e97ce5e0e6b257117cddadf6529"} Jul 13 19:37:19.114412 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.114089 2555 scope.go:117] "RemoveContainer" containerID="a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80" Jul 13 19:37:19.122609 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.122589 2555 scope.go:117] "RemoveContainer" containerID="a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80" Jul 13 19:37:19.122892 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:37:19.122873 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80\": container with ID starting with a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80 not found: ID does not exist" containerID="a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80" Jul 13 19:37:19.122947 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.122903 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80"} err="failed to get container status \"a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80\": rpc error: code = NotFound desc = could not find container \"a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80\": container with ID starting with a4601d7dd6d32b4ddcb635f1e5213cde8fed4681794e03a744932e744bbc5b80 not found: ID does not exist" Jul 13 19:37:19.135152 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.135130 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dfccx"] Jul 13 19:37:19.139162 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.139143 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-dfccx"] Jul 13 19:37:19.549429 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:19.549396 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef27c593-5745-45ee-88ed-b6d7a530ca17" path="/var/lib/kubelet/pods/ef27c593-5745-45ee-88ed-b6d7a530ca17/volumes" Jul 13 19:37:25.094384 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:25.094356 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hfgh4" Jul 13 19:37:29.644302 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:29.644264 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:29.749179 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:29.749096 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:30.105875 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:30.105842 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:42.112969 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.112934 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7z4lb"] Jul 13 19:37:42.113455 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.113238 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef27c593-5745-45ee-88ed-b6d7a530ca17" containerName="authorino" Jul 13 19:37:42.113455 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.113250 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef27c593-5745-45ee-88ed-b6d7a530ca17" containerName="authorino" Jul 13 19:37:42.113455 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.113300 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef27c593-5745-45ee-88ed-b6d7a530ca17" containerName="authorino" Jul 13 19:37:42.117534 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.117515 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7z4lb" Jul 13 19:37:42.121525 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.121503 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kqs99\"" Jul 13 19:37:42.131282 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.131258 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7z4lb"] Jul 13 19:37:42.256602 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.256565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:42.261157 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.261132 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksksf\" (UniqueName: \"kubernetes.io/projected/82e6226e-5ac4-4e62-8e10-e48cd12a5b41-kube-api-access-ksksf\") pod \"authorino-5d4b67c446-7z4lb\" (UID: \"82e6226e-5ac4-4e62-8e10-e48cd12a5b41\") " pod="kuadrant-system/authorino-5d4b67c446-7z4lb" Jul 13 19:37:42.332268 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.332230 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7z4lb"] Jul 13 19:37:42.332493 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:37:42.332474 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ksksf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-7z4lb" podUID="82e6226e-5ac4-4e62-8e10-e48cd12a5b41" Jul 13 19:37:42.336045 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.336020 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:42.356343 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.356311 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d877c8b8b-xpgtq"] Jul 13 19:37:42.359554 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.359535 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d877c8b8b-xpgtq" Jul 13 19:37:42.361899 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.361878 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksksf\" (UniqueName: \"kubernetes.io/projected/82e6226e-5ac4-4e62-8e10-e48cd12a5b41-kube-api-access-ksksf\") pod \"authorino-5d4b67c446-7z4lb\" (UID: \"82e6226e-5ac4-4e62-8e10-e48cd12a5b41\") " pod="kuadrant-system/authorino-5d4b67c446-7z4lb" Jul 13 19:37:42.367153 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.367130 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d877c8b8b-xpgtq"] Jul 13 19:37:42.372470 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.372438 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksksf\" (UniqueName: \"kubernetes.io/projected/82e6226e-5ac4-4e62-8e10-e48cd12a5b41-kube-api-access-ksksf\") pod \"authorino-5d4b67c446-7z4lb\" (UID: \"82e6226e-5ac4-4e62-8e10-e48cd12a5b41\") " pod="kuadrant-system/authorino-5d4b67c446-7z4lb" Jul 13 19:37:42.429649 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.429618 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d877c8b8b-xpgtq"] Jul 13 19:37:42.429888 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:37:42.429863 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gmpp6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7d877c8b8b-xpgtq" podUID="7003c034-d19b-431f-bd9f-9caf1fd60b3e" Jul 13 19:37:42.463376 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.463327 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmpp6\" (UniqueName: \"kubernetes.io/projected/7003c034-d19b-431f-bd9f-9caf1fd60b3e-kube-api-access-gmpp6\") pod \"authorino-7d877c8b8b-xpgtq\" (UID: \"7003c034-d19b-431f-bd9f-9caf1fd60b3e\") " pod="kuadrant-system/authorino-7d877c8b8b-xpgtq" Jul 13 19:37:42.564269 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.564230 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmpp6\" (UniqueName: \"kubernetes.io/projected/7003c034-d19b-431f-bd9f-9caf1fd60b3e-kube-api-access-gmpp6\") pod \"authorino-7d877c8b8b-xpgtq\" (UID: \"7003c034-d19b-431f-bd9f-9caf1fd60b3e\") " pod="kuadrant-system/authorino-7d877c8b8b-xpgtq" Jul 13 19:37:42.572643 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:42.572610 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmpp6\" (UniqueName: \"kubernetes.io/projected/7003c034-d19b-431f-bd9f-9caf1fd60b3e-kube-api-access-gmpp6\") pod \"authorino-7d877c8b8b-xpgtq\" (UID: \"7003c034-d19b-431f-bd9f-9caf1fd60b3e\") " pod="kuadrant-system/authorino-7d877c8b8b-xpgtq" Jul 13 19:37:43.219746 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.219710 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d877c8b8b-xpgtq" Jul 13 19:37:43.220203 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.219711 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7z4lb" Jul 13 19:37:43.229058 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.229038 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d877c8b8b-xpgtq" Jul 13 19:37:43.231184 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.231171 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7z4lb" Jul 13 19:37:43.370493 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.370455 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksksf\" (UniqueName: \"kubernetes.io/projected/82e6226e-5ac4-4e62-8e10-e48cd12a5b41-kube-api-access-ksksf\") pod \"82e6226e-5ac4-4e62-8e10-e48cd12a5b41\" (UID: \"82e6226e-5ac4-4e62-8e10-e48cd12a5b41\") " Jul 13 19:37:43.370493 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.370492 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmpp6\" (UniqueName: \"kubernetes.io/projected/7003c034-d19b-431f-bd9f-9caf1fd60b3e-kube-api-access-gmpp6\") pod \"7003c034-d19b-431f-bd9f-9caf1fd60b3e\" (UID: \"7003c034-d19b-431f-bd9f-9caf1fd60b3e\") " Jul 13 19:37:43.372916 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.372875 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7003c034-d19b-431f-bd9f-9caf1fd60b3e-kube-api-access-gmpp6" (OuterVolumeSpecName: "kube-api-access-gmpp6") pod "7003c034-d19b-431f-bd9f-9caf1fd60b3e" (UID: "7003c034-d19b-431f-bd9f-9caf1fd60b3e"). InnerVolumeSpecName "kube-api-access-gmpp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:37:43.373070 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.372887 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82e6226e-5ac4-4e62-8e10-e48cd12a5b41-kube-api-access-ksksf" (OuterVolumeSpecName: "kube-api-access-ksksf") pod "82e6226e-5ac4-4e62-8e10-e48cd12a5b41" (UID: "82e6226e-5ac4-4e62-8e10-e48cd12a5b41"). InnerVolumeSpecName "kube-api-access-ksksf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:37:43.471167 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.471079 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksksf\" (UniqueName: \"kubernetes.io/projected/82e6226e-5ac4-4e62-8e10-e48cd12a5b41-kube-api-access-ksksf\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:37:43.471167 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:43.471112 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmpp6\" (UniqueName: \"kubernetes.io/projected/7003c034-d19b-431f-bd9f-9caf1fd60b3e-kube-api-access-gmpp6\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:37:44.223543 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:44.223511 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d877c8b8b-xpgtq" Jul 13 19:37:44.223944 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:44.223511 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-7z4lb" Jul 13 19:37:44.267283 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:44.267250 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7z4lb"] Jul 13 19:37:44.271884 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:44.271857 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-7z4lb"] Jul 13 19:37:44.298141 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:44.298096 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d877c8b8b-xpgtq"] Jul 13 19:37:44.306760 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:44.306721 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d877c8b8b-xpgtq"] Jul 13 19:37:45.554074 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:45.554042 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7003c034-d19b-431f-bd9f-9caf1fd60b3e" path="/var/lib/kubelet/pods/7003c034-d19b-431f-bd9f-9caf1fd60b3e/volumes" Jul 13 19:37:45.554437 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:45.554251 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82e6226e-5ac4-4e62-8e10-e48cd12a5b41" path="/var/lib/kubelet/pods/82e6226e-5ac4-4e62-8e10-e48cd12a5b41/volumes" Jul 13 19:37:48.377131 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:48.377092 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:48.456384 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:48.456351 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:48.510464 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:48.510423 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:48.898210 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:48.898172 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:51.717138 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:51.717092 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:37:51.812498 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:37:51.812463 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:24.290078 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:24.290041 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:24.388134 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:24.388097 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:24.881028 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:24.880971 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:24.977995 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:24.977945 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:25.270590 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:25.270507 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:25.355847 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:25.355811 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:25.488847 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:25.488812 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:38:33.431000 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:33.430943 2555 generic.go:356] "Generic (PLEG): container finished" podID="ea478e9b-3cbc-4909-bead-3f35b669a550" containerID="2727379196e2252fc2b30053f3b856bd850a8b775fd4b4d8848dcfacc41e85e1" exitCode=0 Jul 13 19:38:33.431406 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:33.431022 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" event={"ID":"ea478e9b-3cbc-4909-bead-3f35b669a550","Type":"ContainerDied","Data":"2727379196e2252fc2b30053f3b856bd850a8b775fd4b4d8848dcfacc41e85e1"} Jul 13 19:38:33.431406 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:33.431393 2555 scope.go:117] "RemoveContainer" containerID="2727379196e2252fc2b30053f3b856bd850a8b775fd4b4d8848dcfacc41e85e1" Jul 13 19:38:33.432369 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:33.432344 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:38:33.432438 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:33.432422 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:38:33.432484 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:33.432470 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:38:34.440389 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:34.440352 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" event={"ID":"ea478e9b-3cbc-4909-bead-3f35b669a550","Type":"ContainerStarted","Data":"63d1e3803e51a458885814edee8faf202b86a1dab634df50237ff615731b64b2"} Jul 13 19:38:34.619875 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:34.619844 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:38:34.620101 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:34.620077 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dlgfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 13 19:38:34.620160 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:34.620141 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" podUID="ea478e9b-3cbc-4909-bead-3f35b669a550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 13 19:38:35.124914 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:35.124876 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:35.228282 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:35.228244 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:35.620003 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:35.619938 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dlgfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 13 19:38:35.620387 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:35.620029 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" podUID="ea478e9b-3cbc-4909-bead-3f35b669a550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 13 19:38:36.620518 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:36.620477 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dlgfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 13 19:38:36.620933 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:36.620538 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" podUID="ea478e9b-3cbc-4909-bead-3f35b669a550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 13 19:38:37.620850 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:37.620817 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dlgfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 13 19:38:37.621294 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:37.620873 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" podUID="ea478e9b-3cbc-4909-bead-3f35b669a550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 13 19:38:38.620358 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:38.620312 2555 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dlgfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 13 19:38:38.620531 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:38.620374 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" podUID="ea478e9b-3cbc-4909-bead-3f35b669a550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 13 19:38:39.624299 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:39.624268 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:38:39.624694 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:39.624570 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:38:39.625266 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:39.625249 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dlgfr" Jul 13 19:38:43.391578 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:43.391535 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:43.873955 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:43.873924 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:38:56.214884 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:56.214781 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:38:56.979217 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:38:56.979182 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:39:02.885696 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.885660 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-brc25"] Jul 13 19:39:02.889049 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.889021 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:02.892062 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.892023 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 19:39:02.893068 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.893044 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rx4h8\"" Jul 13 19:39:02.893282 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.893258 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 13 19:39:02.893343 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.893294 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 19:39:02.898270 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.898244 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-brc25"] Jul 13 19:39:02.931317 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.931263 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:39:02.973415 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.973387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d2dcebb-5e27-4013-b143-4438556360c2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:02.973601 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.973422 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:02.973601 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.973447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffmk\" (UniqueName: \"kubernetes.io/projected/1d2dcebb-5e27-4013-b143-4438556360c2-kube-api-access-cffmk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:02.973601 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.973570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:02.973601 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.973599 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:02.973729 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:02.973622 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.074056 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.074021 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.074247 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.074068 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d2dcebb-5e27-4013-b143-4438556360c2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.074247 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.074105 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.074247 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.074138 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cffmk\" (UniqueName: \"kubernetes.io/projected/1d2dcebb-5e27-4013-b143-4438556360c2-kube-api-access-cffmk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.074247 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.074220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.074247 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.074243 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.074566 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.074497 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.074566 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.074547 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.074638 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.074578 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.076606 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.076581 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d2dcebb-5e27-4013-b143-4438556360c2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.076886 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.076865 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d2dcebb-5e27-4013-b143-4438556360c2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.082363 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.082331 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffmk\" (UniqueName: \"kubernetes.io/projected/1d2dcebb-5e27-4013-b143-4438556360c2-kube-api-access-cffmk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-brc25\" (UID: \"1d2dcebb-5e27-4013-b143-4438556360c2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.201359 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.201267 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:03.341051 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.341011 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-brc25"] Jul 13 19:39:03.343961 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:39:03.343915 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2dcebb_5e27_4013_b143_4438556360c2.slice/crio-dc777eb4acad0a8911188f8a5718e34b89e532e8e4f6a8c16dfefaded6ff52ff WatchSource:0}: Error finding container dc777eb4acad0a8911188f8a5718e34b89e532e8e4f6a8c16dfefaded6ff52ff: Status 404 returned error can't find the container with id dc777eb4acad0a8911188f8a5718e34b89e532e8e4f6a8c16dfefaded6ff52ff Jul 13 19:39:03.576218 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:03.576185 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" event={"ID":"1d2dcebb-5e27-4013-b143-4438556360c2","Type":"ContainerStarted","Data":"dc777eb4acad0a8911188f8a5718e34b89e532e8e4f6a8c16dfefaded6ff52ff"} Jul 13 19:39:04.177407 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:04.177359 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:39:04.582356 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:04.582312 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" event={"ID":"1d2dcebb-5e27-4013-b143-4438556360c2","Type":"ContainerStarted","Data":"0bd8070fd76073951fbf3a0086c739aebbca29417afc035047f281e8248e873a"} Jul 13 19:39:04.603596 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:04.603545 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" podStartSLOduration=1.542316789 podStartE2EDuration="2.603529475s" totalImagesPullingTime="1.061212686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:39:04.601668906 +0000 UTC m=+815.648223204" watchObservedRunningTime="2026-07-13 19:39:04.603529475 +0000 UTC m=+815.650083744" Jul 13 19:39:07.812957 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:07.812907 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:39:09.176462 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:09.176425 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:39:12.377302 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.377265 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm"] Jul 13 19:39:12.385447 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.385410 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.389381 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.389350 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 13 19:39:12.391280 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.391253 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm"] Jul 13 19:39:12.407595 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.407566 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:39:12.455053 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.455011 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.455053 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.455059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.455256 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.455149 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjf9w\" (UniqueName: \"kubernetes.io/projected/8a274c0d-41c0-42e2-878d-01e192a74e53-kube-api-access-mjf9w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.455256 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.455191 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a274c0d-41c0-42e2-878d-01e192a74e53-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.455256 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.455245 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.455368 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.455302 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.556830 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.556796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjf9w\" (UniqueName: \"kubernetes.io/projected/8a274c0d-41c0-42e2-878d-01e192a74e53-kube-api-access-mjf9w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.556830 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.556836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a274c0d-41c0-42e2-878d-01e192a74e53-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.557150 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.556903 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.557150 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.556921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.557150 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.556968 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.557150 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.557048 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.557415 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.557394 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.557477 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.557442 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.557567 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.557544 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.559796 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.559770 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a274c0d-41c0-42e2-878d-01e192a74e53-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.559796 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.559787 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a274c0d-41c0-42e2-878d-01e192a74e53-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.564888 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.564855 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjf9w\" (UniqueName: \"kubernetes.io/projected/8a274c0d-41c0-42e2-878d-01e192a74e53-kube-api-access-mjf9w\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mmkjm\" (UID: \"8a274c0d-41c0-42e2-878d-01e192a74e53\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.697943 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.697848 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:12.836756 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:12.836732 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm"] Jul 13 19:39:12.839494 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:39:12.839467 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a274c0d_41c0_42e2_878d_01e192a74e53.slice/crio-198c72396166e93722ce4c00f7b36119512b0bed454881b979ac4838a61d9200 WatchSource:0}: Error finding container 198c72396166e93722ce4c00f7b36119512b0bed454881b979ac4838a61d9200: Status 404 returned error can't find the container with id 198c72396166e93722ce4c00f7b36119512b0bed454881b979ac4838a61d9200 Jul 13 19:39:13.201941 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:13.201903 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:13.202148 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:13.202007 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:13.214155 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:13.214128 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:13.628065 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:13.628019 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" event={"ID":"8a274c0d-41c0-42e2-878d-01e192a74e53","Type":"ContainerStarted","Data":"cc45b13fa397ace249468ca895f419e9e6dcb2f2b8f9e7138d2050f555a49858"} Jul 13 19:39:13.628534 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:13.628084 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" event={"ID":"8a274c0d-41c0-42e2-878d-01e192a74e53","Type":"ContainerStarted","Data":"198c72396166e93722ce4c00f7b36119512b0bed454881b979ac4838a61d9200"} Jul 13 19:39:13.639770 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:13.639744 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-brc25" Jul 13 19:39:13.645939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:13.645895 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" podStartSLOduration=1.452499915 podStartE2EDuration="1.645880471s" totalImagesPullingTime="193.380556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:39:13.644971848 +0000 UTC m=+824.691526123" watchObservedRunningTime="2026-07-13 19:39:13.645880471 +0000 UTC m=+824.692434741" Jul 13 19:39:18.785849 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:18.782886 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:39:22.698269 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:22.698231 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:22.698707 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:22.698300 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:22.710850 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:22.710825 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:23.682405 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:23.682377 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mmkjm" Jul 13 19:39:27.255246 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:27.255210 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:39:27.311291 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:27.311261 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:39:29.572362 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.572316 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5"] Jul 13 19:39:29.575674 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.575655 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.582029 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.582000 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 13 19:39:29.587492 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.587465 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5"] Jul 13 19:39:29.606545 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.606501 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:39:29.703350 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.703314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76027c53-4e1e-490b-98e7-3d144b472753-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.703510 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.703367 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.703510 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.703433 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.703510 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.703458 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzs8w\" (UniqueName: \"kubernetes.io/projected/76027c53-4e1e-490b-98e7-3d144b472753-kube-api-access-fzs8w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.703654 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.703514 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.703654 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.703543 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.804850 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.804806 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.804850 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.804849 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzs8w\" (UniqueName: \"kubernetes.io/projected/76027c53-4e1e-490b-98e7-3d144b472753-kube-api-access-fzs8w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.805129 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.804893 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.805129 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.804916 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.805129 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.804945 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76027c53-4e1e-490b-98e7-3d144b472753-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.805129 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.805066 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.805310 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.805290 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.805353 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.805335 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.805389 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.805367 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.807390 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.807359 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76027c53-4e1e-490b-98e7-3d144b472753-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.807734 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.807713 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76027c53-4e1e-490b-98e7-3d144b472753-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.812915 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.812892 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzs8w\" (UniqueName: \"kubernetes.io/projected/76027c53-4e1e-490b-98e7-3d144b472753-kube-api-access-fzs8w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5\" (UID: \"76027c53-4e1e-490b-98e7-3d144b472753\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:29.892213 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:29.892117 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:30.033596 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:30.033496 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5"] Jul 13 19:39:30.036353 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:39:30.036324 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76027c53_4e1e_490b_98e7_3d144b472753.slice/crio-e0c63ee39de1089d377ea95218c75ca576780652d41bbbeef258af46440c24aa WatchSource:0}: Error finding container e0c63ee39de1089d377ea95218c75ca576780652d41bbbeef258af46440c24aa: Status 404 returned error can't find the container with id e0c63ee39de1089d377ea95218c75ca576780652d41bbbeef258af46440c24aa Jul 13 19:39:30.704150 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:30.704117 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" event={"ID":"76027c53-4e1e-490b-98e7-3d144b472753","Type":"ContainerStarted","Data":"3cae969709b452146b5b0bf67210ffeec4406a2d9632b3f554697e0c4280909b"} Jul 13 19:39:30.704150 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:30.704158 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" event={"ID":"76027c53-4e1e-490b-98e7-3d144b472753","Type":"ContainerStarted","Data":"e0c63ee39de1089d377ea95218c75ca576780652d41bbbeef258af46440c24aa"} Jul 13 19:39:30.721766 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:30.721712 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" podStartSLOduration=1.527245018 podStartE2EDuration="1.72169362s" totalImagesPullingTime="194.448602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:39:30.719792778 +0000 UTC m=+841.766347050" watchObservedRunningTime="2026-07-13 19:39:30.72169362 +0000 UTC m=+841.768247889" Jul 13 19:39:31.076059 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:31.076028 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:39:39.892415 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:39.892361 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:39.892415 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:39.892426 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:39.904861 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:39.904835 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:39:40.762234 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:39:40.762204 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5" Jul 13 19:40:29.518548 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:29.518516 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:40:29.519158 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:29.519130 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:40:50.524996 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:50.524941 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:53.667027 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.666991 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-549fcbd77f-cdztp"] Jul 13 19:40:53.670147 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.670132 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549fcbd77f-cdztp" Jul 13 19:40:53.673871 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.673850 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 13 19:40:53.674011 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.673852 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kqs99\"" Jul 13 19:40:53.677393 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.677252 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-549fcbd77f-cdztp"] Jul 13 19:40:53.787777 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.787751 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htsdv\" (UniqueName: \"kubernetes.io/projected/f2b649f4-1e06-48e7-9eae-0fa95a582dd9-kube-api-access-htsdv\") pod \"authorino-549fcbd77f-cdztp\" (UID: \"f2b649f4-1e06-48e7-9eae-0fa95a582dd9\") " pod="kuadrant-system/authorino-549fcbd77f-cdztp" Jul 13 19:40:53.787910 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.787803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2b649f4-1e06-48e7-9eae-0fa95a582dd9-tls-cert\") pod \"authorino-549fcbd77f-cdztp\" (UID: \"f2b649f4-1e06-48e7-9eae-0fa95a582dd9\") " pod="kuadrant-system/authorino-549fcbd77f-cdztp" Jul 13 19:40:53.888647 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.888615 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2b649f4-1e06-48e7-9eae-0fa95a582dd9-tls-cert\") pod \"authorino-549fcbd77f-cdztp\" (UID: \"f2b649f4-1e06-48e7-9eae-0fa95a582dd9\") " pod="kuadrant-system/authorino-549fcbd77f-cdztp" Jul 13 19:40:53.888758 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.888743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htsdv\" (UniqueName: \"kubernetes.io/projected/f2b649f4-1e06-48e7-9eae-0fa95a582dd9-kube-api-access-htsdv\") pod \"authorino-549fcbd77f-cdztp\" (UID: \"f2b649f4-1e06-48e7-9eae-0fa95a582dd9\") " pod="kuadrant-system/authorino-549fcbd77f-cdztp" Jul 13 19:40:53.891106 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.891091 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2b649f4-1e06-48e7-9eae-0fa95a582dd9-tls-cert\") pod \"authorino-549fcbd77f-cdztp\" (UID: \"f2b649f4-1e06-48e7-9eae-0fa95a582dd9\") " pod="kuadrant-system/authorino-549fcbd77f-cdztp" Jul 13 19:40:53.897336 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.897305 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htsdv\" (UniqueName: \"kubernetes.io/projected/f2b649f4-1e06-48e7-9eae-0fa95a582dd9-kube-api-access-htsdv\") pod \"authorino-549fcbd77f-cdztp\" (UID: \"f2b649f4-1e06-48e7-9eae-0fa95a582dd9\") " pod="kuadrant-system/authorino-549fcbd77f-cdztp" Jul 13 19:40:53.980503 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:53.980440 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549fcbd77f-cdztp" Jul 13 19:40:54.116273 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:54.116250 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-549fcbd77f-cdztp"] Jul 13 19:40:54.118751 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:40:54.118719 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2b649f4_1e06_48e7_9eae_0fa95a582dd9.slice/crio-9f1b769b52ce00a025ca725da0ae343f16daa47f524bd2a02344f9d56fdd294c WatchSource:0}: Error finding container 9f1b769b52ce00a025ca725da0ae343f16daa47f524bd2a02344f9d56fdd294c: Status 404 returned error can't find the container with id 9f1b769b52ce00a025ca725da0ae343f16daa47f524bd2a02344f9d56fdd294c Jul 13 19:40:54.153960 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:54.153929 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:54.251929 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:54.251843 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:55.087020 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:55.086959 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549fcbd77f-cdztp" event={"ID":"f2b649f4-1e06-48e7-9eae-0fa95a582dd9","Type":"ContainerStarted","Data":"8ecfe0afe85b34912a357cb3da1e050851de302088015e8578b37131a27a9794"} Jul 13 19:40:55.087389 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:55.087028 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549fcbd77f-cdztp" event={"ID":"f2b649f4-1e06-48e7-9eae-0fa95a582dd9","Type":"ContainerStarted","Data":"9f1b769b52ce00a025ca725da0ae343f16daa47f524bd2a02344f9d56fdd294c"} Jul 13 19:40:55.103362 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:55.103308 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-549fcbd77f-cdztp" podStartSLOduration=1.639137493 podStartE2EDuration="2.103290146s" totalImagesPullingTime="464.152653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:40:55.102449765 +0000 UTC m=+926.149004032" watchObservedRunningTime="2026-07-13 19:40:55.103290146 +0000 UTC m=+926.149844416" Jul 13 19:40:55.419453 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:55.419355 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:40:55.519033 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:40:55.518997 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:06.278536 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:41:06.278505 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:24.194296 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:41:24.194254 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:41:34.680549 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:41:34.680514 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:41:45.682041 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:41:45.682005 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:41:48.252202 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:41:48.252169 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:56.297254 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:41:56.297181 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:41:57.530275 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:41:57.530235 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:41:57.630705 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:41:57.630659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:06.484411 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:06.484375 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:42:08.409139 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:08.409098 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:10.292699 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:10.292662 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:32.280907 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:32.280866 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:42:44.379744 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:44.379710 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:42:49.447392 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:49.447337 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:49.566391 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:49.566351 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:49.735363 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:49.735272 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:55.374970 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:55.374930 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:55.479666 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:55.479630 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:55.618128 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:55.618095 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:42:55.724804 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:42:55.724712 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:01.764436 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:43:01.764404 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:01.864231 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:43:01.864201 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:43:19.377584 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:43:19.377548 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:43:28.385166 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:43:28.385134 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:43:39.077993 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:43:39.077947 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:43:47.774935 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:43:47.774903 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:43:59.075743 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:43:59.075700 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:44:09.490403 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:44:09.490368 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:09.547923 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:44:09.547882 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:44:09.882990 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:44:09.882940 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:44:22.179345 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:44:22.179304 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:44:31.988707 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:44:31.988670 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:44:53.888191 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:44:53.887994 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:45:05.977074 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:45:05.977029 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:45:28.575523 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:45:28.575486 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:45:29.550834 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:45:29.550803 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:45:29.552743 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:45:29.552716 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:45:39.097878 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:45:39.097843 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:45:54.791556 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:45:54.791515 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:46:04.684928 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:46:04.684895 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:46:14.888921 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:46:14.888883 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:46:24.681250 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:46:24.681170 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:46:34.283271 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:46:34.283237 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:47:00.333485 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:00.333444 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9"] Jul 13 19:47:00.334132 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:00.333703 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" podUID="6fe828e0-03b6-41c3-aacb-8e4902093b8e" containerName="manager" containerID="cri-o://2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e" gracePeriod=10 Jul 13 19:47:04.119814 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.119789 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:47:04.191171 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.191091 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv5jc\" (UniqueName: \"kubernetes.io/projected/6fe828e0-03b6-41c3-aacb-8e4902093b8e-kube-api-access-pv5jc\") pod \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\" (UID: \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\") " Jul 13 19:47:04.191171 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.191139 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fe828e0-03b6-41c3-aacb-8e4902093b8e-extensions-socket-volume\") pod \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\" (UID: \"6fe828e0-03b6-41c3-aacb-8e4902093b8e\") " Jul 13 19:47:04.191565 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.191538 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fe828e0-03b6-41c3-aacb-8e4902093b8e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6fe828e0-03b6-41c3-aacb-8e4902093b8e" (UID: "6fe828e0-03b6-41c3-aacb-8e4902093b8e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:47:04.193344 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.193322 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe828e0-03b6-41c3-aacb-8e4902093b8e-kube-api-access-pv5jc" (OuterVolumeSpecName: "kube-api-access-pv5jc") pod "6fe828e0-03b6-41c3-aacb-8e4902093b8e" (UID: "6fe828e0-03b6-41c3-aacb-8e4902093b8e"). InnerVolumeSpecName "kube-api-access-pv5jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:47:04.292054 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.292020 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv5jc\" (UniqueName: \"kubernetes.io/projected/6fe828e0-03b6-41c3-aacb-8e4902093b8e-kube-api-access-pv5jc\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:47:04.292054 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.292046 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fe828e0-03b6-41c3-aacb-8e4902093b8e-extensions-socket-volume\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:47:04.799763 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.799726 2555 generic.go:356] "Generic (PLEG): container finished" podID="6fe828e0-03b6-41c3-aacb-8e4902093b8e" containerID="2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e" exitCode=0 Jul 13 19:47:04.799925 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.799780 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" Jul 13 19:47:04.799925 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.799811 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" event={"ID":"6fe828e0-03b6-41c3-aacb-8e4902093b8e","Type":"ContainerDied","Data":"2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e"} Jul 13 19:47:04.799925 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.799870 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9" event={"ID":"6fe828e0-03b6-41c3-aacb-8e4902093b8e","Type":"ContainerDied","Data":"70a50379f233a9e75ccabd6f62130cc17a27b4dfd107419fa7fe792588132145"} Jul 13 19:47:04.799925 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.799893 2555 scope.go:117] "RemoveContainer" containerID="2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e" Jul 13 19:47:04.809785 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.809766 2555 scope.go:117] "RemoveContainer" containerID="2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e" Jul 13 19:47:04.811019 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:47:04.810487 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e\": container with ID starting with 2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e not found: ID does not exist" containerID="2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e" Jul 13 19:47:04.811019 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.810531 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e"} err="failed to get container status \"2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e\": rpc error: code = NotFound desc = could not find container \"2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e\": container with ID starting with 2e1a766802bc9d33c93af50a283f9cb4f63309d849ff5f00d805b6f3d943fe2e not found: ID does not exist" Jul 13 19:47:04.822532 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.822508 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9"] Jul 13 19:47:04.826512 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:04.826491 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dv9q9"] Jul 13 19:47:05.549496 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:47:05.549452 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fe828e0-03b6-41c3-aacb-8e4902093b8e" path="/var/lib/kubelet/pods/6fe828e0-03b6-41c3-aacb-8e4902093b8e/volumes" Jul 13 19:48:01.537172 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.537095 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2"] Jul 13 19:48:01.537606 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.537403 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe828e0-03b6-41c3-aacb-8e4902093b8e" containerName="manager" Jul 13 19:48:01.537606 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.537413 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe828e0-03b6-41c3-aacb-8e4902093b8e" containerName="manager" Jul 13 19:48:01.537606 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.537462 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe828e0-03b6-41c3-aacb-8e4902093b8e" containerName="manager" Jul 13 19:48:01.540361 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.540342 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:01.543443 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.543422 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vscnb\"" Jul 13 19:48:01.551855 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.551835 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2"] Jul 13 19:48:01.681855 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.681821 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6gst\" (UniqueName: \"kubernetes.io/projected/f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9-kube-api-access-t6gst\") pod \"kuadrant-operator-controller-manager-86878c769f-kvzz2\" (UID: \"f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:01.682063 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.681873 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kvzz2\" (UID: \"f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:01.782417 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.782381 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6gst\" (UniqueName: \"kubernetes.io/projected/f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9-kube-api-access-t6gst\") pod \"kuadrant-operator-controller-manager-86878c769f-kvzz2\" (UID: \"f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:01.782595 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.782433 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kvzz2\" (UID: \"f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:01.782888 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.782867 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kvzz2\" (UID: \"f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:01.797183 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.797149 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6gst\" (UniqueName: \"kubernetes.io/projected/f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9-kube-api-access-t6gst\") pod \"kuadrant-operator-controller-manager-86878c769f-kvzz2\" (UID: \"f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:01.852132 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:01.852090 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:02.043332 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:48:02.043301 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f6cf27_1d6c_49df_bd4c_36d56bc7c9d9.slice/crio-395a5b294d5a2df42646bf69256efb99bef5bbf4e2f6395f86c9703a8e7c0d79 WatchSource:0}: Error finding container 395a5b294d5a2df42646bf69256efb99bef5bbf4e2f6395f86c9703a8e7c0d79: Status 404 returned error can't find the container with id 395a5b294d5a2df42646bf69256efb99bef5bbf4e2f6395f86c9703a8e7c0d79 Jul 13 19:48:02.046882 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:02.046839 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2"] Jul 13 19:48:03.059386 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:03.059349 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" event={"ID":"f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9","Type":"ContainerStarted","Data":"ee8d02d73b28f49d10e6c520c135ca07757f315687bda3d7a2665ea84a65a2c3"} Jul 13 19:48:03.059780 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:03.059419 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" event={"ID":"f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9","Type":"ContainerStarted","Data":"395a5b294d5a2df42646bf69256efb99bef5bbf4e2f6395f86c9703a8e7c0d79"} Jul 13 19:48:03.059780 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:03.059492 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:03.084198 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:03.084072 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" podStartSLOduration=2.084057184 podStartE2EDuration="2.084057184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:48:03.082233631 +0000 UTC m=+1354.128787921" watchObservedRunningTime="2026-07-13 19:48:03.084057184 +0000 UTC m=+1354.130611455" Jul 13 19:48:11.473523 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:11.473471 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:14.066195 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:14.066162 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kvzz2" Jul 13 19:48:22.088359 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:22.088324 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:48:32.979533 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:32.979499 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:48:43.777632 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:43.777596 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:48:48.263790 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:48.263755 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:48:54.680836 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:48:54.680805 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:49:06.480523 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:49:06.480487 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:49:14.990284 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:49:14.990248 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:49:23.685292 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:49:23.685215 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:49:33.178183 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:49:33.178150 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:49:41.380341 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:49:41.380301 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:49:52.478373 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:49:52.478338 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:49:57.145037 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:49:57.145001 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:49:57.246115 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:49:57.246085 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:50:05.683342 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:50:05.683305 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:50:16.376782 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:50:16.376747 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:50:29.581649 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:50:29.581617 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:50:29.587372 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:50:29.587350 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:50:32.381924 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:50:32.381888 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:50:39.786251 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:50:39.786214 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:50:40.602832 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:50:40.602795 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:50:50.079721 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:50:50.079645 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:51:00.174341 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:51:00.174296 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:51:09.579733 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:51:09.579694 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:51:22.180199 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:51:22.180160 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:51:36.987265 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:51:36.987223 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:51:46.279690 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:51:46.279654 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:51:59.894868 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:51:59.894836 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:52:09.283057 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:52:09.283020 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:52:22.983596 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:52:22.983500 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:52:32.885869 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:52:32.885828 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:52:43.086502 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:52:43.086464 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:52:55.715768 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:52:55.715729 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:53:05.888029 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:53:05.887971 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:53:16.096136 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:53:16.096089 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:53:29.132397 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:53:29.132359 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:53:42.089557 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:53:42.089520 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:53:51.074346 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:53:51.074265 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:51.600453 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:53:51.600417 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:53:53.060257 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:53:53.060220 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:53:54.065232 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:53:54.065190 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:01.812772 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:01.812729 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:05.286261 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:05.286224 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:54:10.068841 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:10.068804 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:13.888008 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:13.887276 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:54:15.167994 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:15.167951 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:18.224959 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:18.224918 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:18.315904 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:18.315868 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:18.671685 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:18.671652 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:24.288519 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:24.288462 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:24.389103 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:24.389069 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:24.513504 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:24.513477 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:24.592616 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:24.592583 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:54:24.601155 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:24.601117 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:25.615569 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:25.615533 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:25.704259 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:25.704229 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:25.864941 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:25.864910 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:25.972046 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:25.971919 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:26.396726 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:26.396688 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:26.498598 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:26.498564 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:28.110111 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:28.110080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:35.882306 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:35.882273 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:54:41.081487 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:41.081452 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:45.089806 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:45.089769 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:54:45.766112 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:45.766073 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:51.421729 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:51.421694 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:51.730014 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:51.729917 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:55.955094 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:55.955061 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:56.318925 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.318893 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:56.419508 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.419468 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:56.479727 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.479697 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p"] Jul 13 19:54:56.482894 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.482875 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.486195 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.486176 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-ac3fa3ea-gw-openshift-default-dockercfg-qwrdg\"" Jul 13 19:54:56.497785 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.497756 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p"] Jul 13 19:54:56.523940 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.523905 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:56.590130 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.590037 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-certs\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.590130 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.590093 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5frw\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-kube-api-access-f5frw\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.590358 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.590153 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-token\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.590358 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.590182 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-envoy\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.590358 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.590230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-socket\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.590358 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.590262 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-credential-socket\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.590358 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.590284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-data\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.590538 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.590375 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-podinfo\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.590538 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.590405 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86501b9-2289-475a-bb42-63bf755eb0fe-istiod-ca-cert\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.691538 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.691501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-socket\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.691538 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.691541 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-credential-socket\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.691819 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.691560 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-data\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.691819 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.691672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-podinfo\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.691819 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.691729 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86501b9-2289-475a-bb42-63bf755eb0fe-istiod-ca-cert\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.691819 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.691799 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-certs\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.692080 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.691860 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5frw\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-kube-api-access-f5frw\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.692080 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.691893 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-token\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.692080 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.691955 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-envoy\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.692080 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.692015 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-credential-socket\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.692294 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.692079 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-data\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.692294 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.692189 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-certs\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.692504 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.692482 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-socket\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.692622 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.692604 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86501b9-2289-475a-bb42-63bf755eb0fe-istiod-ca-cert\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.694247 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.694227 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-envoy\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.694337 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.694283 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-podinfo\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.713841 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.713800 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5frw\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-kube-api-access-f5frw\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.716992 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.716947 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-token\") pod \"e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.795032 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.794968 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:56.936925 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.936901 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p"] Jul 13 19:54:56.938896 ip-10-0-134-100 kubenswrapper[2555]: W0713 19:54:56.938870 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86501b9_2289_475a_bb42_63bf755eb0fe.slice/crio-1ff066ad62f0e8942424d9dcf3ac1052e5969085f3b0bc7176083c213b394598 WatchSource:0}: Error finding container 1ff066ad62f0e8942424d9dcf3ac1052e5969085f3b0bc7176083c213b394598: Status 404 returned error can't find the container with id 1ff066ad62f0e8942424d9dcf3ac1052e5969085f3b0bc7176083c213b394598 Jul 13 19:54:56.940949 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.940918 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:54:56.941062 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.941021 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:54:56.941123 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.941068 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:54:56.990118 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:56.990073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" event={"ID":"c86501b9-2289-475a-bb42-63bf755eb0fe","Type":"ContainerStarted","Data":"1ff066ad62f0e8942424d9dcf3ac1052e5969085f3b0bc7176083c213b394598"} Jul 13 19:54:57.768819 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:57.768782 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:57.882150 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:57.882106 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:57.996593 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:57.996554 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" event={"ID":"c86501b9-2289-475a-bb42-63bf755eb0fe","Type":"ContainerStarted","Data":"37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7"} Jul 13 19:54:58.016069 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:58.016020 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" podStartSLOduration=2.016002549 podStartE2EDuration="2.016002549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:54:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:54:58.015870745 +0000 UTC m=+1769.062425038" watchObservedRunningTime="2026-07-13 19:54:58.016002549 +0000 UTC m=+1769.062556824" Jul 13 19:54:58.080053 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:58.080014 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:58.350568 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:58.350485 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:58.450709 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:58.450677 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:54:58.796076 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:58.796044 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:58.801294 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:58.801266 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:59.001253 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:59.001226 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:54:59.002258 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:54:59.002236 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:55:02.705323 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:02.705276 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:55:02.778268 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:02.778227 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:55:04.883759 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:04.883728 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:55:06.019773 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:06.019690 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:55:14.002895 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:14.002855 2555 patch_prober.go:28] interesting pod/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 19:55:14.003327 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:14.002931 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 19:55:14.078131 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:14.078096 2555 generic.go:356] "Generic (PLEG): container finished" podID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerID="37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7" exitCode=0 Jul 13 19:55:14.078289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:14.078151 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" event={"ID":"c86501b9-2289-475a-bb42-63bf755eb0fe","Type":"ContainerDied","Data":"37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7"} Jul 13 19:55:14.078533 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:14.078519 2555 scope.go:117] "RemoveContainer" containerID="37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7" Jul 13 19:55:14.079538 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:14.079510 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:55:14.079597 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:14.079583 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:55:14.079635 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:14.079618 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 13 19:55:15.086045 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:15.086006 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" event={"ID":"c86501b9-2289-475a-bb42-63bf755eb0fe","Type":"ContainerStarted","Data":"d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429"} Jul 13 19:55:15.796130 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:15.796090 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:55:15.796344 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:15.796295 2555 patch_prober.go:28] interesting pod/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 19:55:15.796389 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:15.796342 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 19:55:16.795810 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:16.795773 2555 patch_prober.go:28] interesting pod/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 19:55:16.796264 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:16.795833 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 19:55:17.795939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:17.795901 2555 patch_prober.go:28] interesting pod/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 19:55:17.796321 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:17.795964 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 19:55:18.796235 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:18.796201 2555 patch_prober.go:28] interesting pod/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 13 19:55:18.796616 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:18.796254 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 13 19:55:19.799239 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:19.799161 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:55:19.799579 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:19.799485 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:55:19.800227 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:19.800209 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:55:29.608098 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:29.608064 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:55:29.615560 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:55:29.615535 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 19:56:02.436651 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:02.436610 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p"] Jul 13 19:56:02.437242 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:02.436842 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" containerID="cri-o://d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429" gracePeriod=30 Jul 13 19:56:02.477623 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:02.477591 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:02.609765 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:02.609727 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:02.794719 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:02.794640 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:04.802422 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:04.802385 2555 patch_prober.go:28] interesting pod/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 19:56:04.802773 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:04.802477 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 19:56:05.383932 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:05.383901 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:56:07.682525 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.682498 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:56:07.736021 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.735989 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-envoy\") pod \"c86501b9-2289-475a-bb42-63bf755eb0fe\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " Jul 13 19:56:07.736171 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736043 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-certs\") pod \"c86501b9-2289-475a-bb42-63bf755eb0fe\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " Jul 13 19:56:07.736171 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736079 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-podinfo\") pod \"c86501b9-2289-475a-bb42-63bf755eb0fe\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " Jul 13 19:56:07.736171 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736107 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-credential-socket\") pod \"c86501b9-2289-475a-bb42-63bf755eb0fe\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " Jul 13 19:56:07.736171 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736136 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-token\") pod \"c86501b9-2289-475a-bb42-63bf755eb0fe\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " Jul 13 19:56:07.736385 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736176 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-data\") pod \"c86501b9-2289-475a-bb42-63bf755eb0fe\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " Jul 13 19:56:07.736385 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736245 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-socket\") pod \"c86501b9-2289-475a-bb42-63bf755eb0fe\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " Jul 13 19:56:07.736385 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736269 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86501b9-2289-475a-bb42-63bf755eb0fe-istiod-ca-cert\") pod \"c86501b9-2289-475a-bb42-63bf755eb0fe\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " Jul 13 19:56:07.736385 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736303 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5frw\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-kube-api-access-f5frw\") pod \"c86501b9-2289-475a-bb42-63bf755eb0fe\" (UID: \"c86501b9-2289-475a-bb42-63bf755eb0fe\") " Jul 13 19:56:07.736385 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736315 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c86501b9-2289-475a-bb42-63bf755eb0fe" (UID: "c86501b9-2289-475a-bb42-63bf755eb0fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:56:07.736630 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736599 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:56:07.736630 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736603 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c86501b9-2289-475a-bb42-63bf755eb0fe" (UID: "c86501b9-2289-475a-bb42-63bf755eb0fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:56:07.736825 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.736806 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c86501b9-2289-475a-bb42-63bf755eb0fe" (UID: "c86501b9-2289-475a-bb42-63bf755eb0fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:56:07.737155 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.737043 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "c86501b9-2289-475a-bb42-63bf755eb0fe" (UID: "c86501b9-2289-475a-bb42-63bf755eb0fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:56:07.737285 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.737161 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c86501b9-2289-475a-bb42-63bf755eb0fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c86501b9-2289-475a-bb42-63bf755eb0fe" (UID: "c86501b9-2289-475a-bb42-63bf755eb0fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 19:56:07.739289 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.739252 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c86501b9-2289-475a-bb42-63bf755eb0fe" (UID: "c86501b9-2289-475a-bb42-63bf755eb0fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 19:56:07.739618 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.739566 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c86501b9-2289-475a-bb42-63bf755eb0fe" (UID: "c86501b9-2289-475a-bb42-63bf755eb0fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 19:56:07.739618 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.739579 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "c86501b9-2289-475a-bb42-63bf755eb0fe" (UID: "c86501b9-2289-475a-bb42-63bf755eb0fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:56:07.739773 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.739717 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-kube-api-access-f5frw" (OuterVolumeSpecName: "kube-api-access-f5frw") pod "c86501b9-2289-475a-bb42-63bf755eb0fe" (UID: "c86501b9-2289-475a-bb42-63bf755eb0fe"). InnerVolumeSpecName "kube-api-access-f5frw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 19:56:07.837718 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.837686 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-workload-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:56:07.837718 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.837712 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86501b9-2289-475a-bb42-63bf755eb0fe-istiod-ca-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:56:07.837718 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.837722 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5frw\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-kube-api-access-f5frw\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:56:07.837939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.837730 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-envoy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:56:07.837939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.837739 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-podinfo\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:56:07.837939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.837747 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-credential-socket\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:56:07.837939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.837756 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:56:07.837939 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:07.837763 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86501b9-2289-475a-bb42-63bf755eb0fe-istio-data\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 19:56:08.347290 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.347257 2555 generic.go:356] "Generic (PLEG): container finished" podID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerID="d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429" exitCode=0 Jul 13 19:56:08.347470 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.347318 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" Jul 13 19:56:08.347470 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.347339 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" event={"ID":"c86501b9-2289-475a-bb42-63bf755eb0fe","Type":"ContainerDied","Data":"d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429"} Jul 13 19:56:08.347470 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.347390 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p" event={"ID":"c86501b9-2289-475a-bb42-63bf755eb0fe","Type":"ContainerDied","Data":"1ff066ad62f0e8942424d9dcf3ac1052e5969085f3b0bc7176083c213b394598"} Jul 13 19:56:08.347470 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.347411 2555 scope.go:117] "RemoveContainer" containerID="d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429" Jul 13 19:56:08.356590 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.356571 2555 scope.go:117] "RemoveContainer" containerID="37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7" Jul 13 19:56:08.364313 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.364276 2555 scope.go:117] "RemoveContainer" containerID="d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429" Jul 13 19:56:08.364565 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:56:08.364548 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429\": container with ID starting with d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429 not found: ID does not exist" containerID="d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429" Jul 13 19:56:08.364640 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.364573 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429"} err="failed to get container status \"d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429\": rpc error: code = NotFound desc = could not find container \"d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429\": container with ID starting with d956e8b17c849bd887eb4dbe2b106315deac794c9d4ddede96808ed0e7f7f429 not found: ID does not exist" Jul 13 19:56:08.364640 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.364590 2555 scope.go:117] "RemoveContainer" containerID="37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7" Jul 13 19:56:08.364824 ip-10-0-134-100 kubenswrapper[2555]: E0713 19:56:08.364803 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7\": container with ID starting with 37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7 not found: ID does not exist" containerID="37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7" Jul 13 19:56:08.364888 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.364829 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7"} err="failed to get container status \"37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7\": rpc error: code = NotFound desc = could not find container \"37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7\": container with ID starting with 37efde5d4d3e249fbc4b687c5f02910b499eef93edd382918b2febec8e7b3ab7 not found: ID does not exist" Jul 13 19:56:08.378336 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.378313 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p"] Jul 13 19:56:08.385103 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.385075 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-ac3fa3ea-gw-openshift-default-67b65b67dc-87m5p"] Jul 13 19:56:08.515440 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.515409 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:08.590455 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.590421 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:08.793186 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.793157 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:08.974462 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:08.974429 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:09.093512 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:09.093482 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:09.550088 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:09.550062 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" path="/var/lib/kubelet/pods/c86501b9-2289-475a-bb42-63bf755eb0fe/volumes" Jul 13 19:56:09.992167 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:09.992089 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:10.216149 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:10.216118 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:10.316547 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:10.316474 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:10.700882 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:10.700801 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:11.329917 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:11.329883 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:12.156967 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:12.156897 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:56:17.974701 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:56:17.974666 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:57:25.561609 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:25.561576 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:28.378761 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:28.378726 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:57:30.391431 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:30.391384 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:30.899735 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:30.899699 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:30.988591 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:30.988562 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:36.340465 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:36.340426 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:36.421127 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:36.421093 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:41.583113 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:41.583079 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:41.900498 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:41.900464 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:43.031575 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:43.031538 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:43.338716 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:43.338680 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:43.457035 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:43.457000 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:43.672761 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:43.672669 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:43.773737 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:43.773701 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:50.781864 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:50.781826 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:57:53.376677 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:53.376638 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:53.478427 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:53.478371 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:55.903892 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:55.903852 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:56.442345 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:56.442309 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:57:57.178553 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:57:57.178517 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:58:57.961915 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:58:57.961879 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:00.678308 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:00.678269 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 19:59:02.571966 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:02.571919 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:08.559214 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:08.559172 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:08.679997 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:08.679904 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:12.772923 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:12.772888 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:13.402524 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:13.402491 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:13.501798 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:13.501761 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:13.605153 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:13.605117 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:15.171161 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:15.171121 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:19.193561 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:19.193370 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:21.116541 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:21.116506 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:21.189103 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:21.189063 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:21.278366 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:21.278333 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:21.378707 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:21.378623 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:21.476435 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:21.476407 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:21.870755 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:21.870723 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:47.866587 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:47.866549 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:53.618594 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:53.618511 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:53.736158 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:53.736116 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 19:59:53.865243 ip-10-0-134-100 kubenswrapper[2555]: I0713 19:59:53.865211 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:10.013428 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:10.013393 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:16.007847 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:16.007805 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:16.116151 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:16.116124 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:16.229334 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:16.229300 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:26.782622 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:26.782592 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:27.593176 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:27.593141 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:29.633337 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:29.633307 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 20:00:29.640558 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:29.640538 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 20:00:33.253785 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:33.253746 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:33.321533 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:33.321499 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:33.423335 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:33.423297 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:33.525420 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:33.525338 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:33.626222 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:33.626187 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:34.342106 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:34.342049 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:34.487701 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:34.487667 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:35.413052 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:35.413018 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:35.988323 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:35.988291 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:00:36.298806 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:36.298777 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:42.412073 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:42.412042 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:42.498139 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:42.498100 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:43.111484 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:43.111452 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:43.683886 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:43.683853 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:00:49.195909 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:49.195871 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:50.218494 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:50.218457 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:50.319786 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:50.319746 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:52.537500 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:52.537466 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:52.641717 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:52.641682 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:52.716565 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:52.716532 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:52.815413 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:52.815376 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:52.893289 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:52.893252 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:00:53.162924 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:53.162839 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:53.253771 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:53.253739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:57.049680 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:57.049646 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:57.707146 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:57.707116 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:58.639426 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:58.639395 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:00:58.741374 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:00:58.741336 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:02.984886 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:02.984851 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:01:04.036765 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:04.036729 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:04.106798 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:04.106762 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:14.797355 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:14.797313 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:17.682519 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:17.682488 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:01:19.481864 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:19.481827 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:25.202216 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:25.202181 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:25.302412 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:25.302383 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:30.220341 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:30.220301 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:30.390632 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:30.390602 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:30.513408 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:30.513333 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:30.672289 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:30.672253 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:30.773929 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:30.773841 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:36.553069 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:36.553034 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:36.659359 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:36.659324 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:36.757725 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:36.757689 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:36.926205 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:36.926121 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:42.647401 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:42.647368 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:42.730869 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:42.730842 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:49.477874 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:49.477840 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:49.808768 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:49.808736 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:50.211729 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:50.211648 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:52.695808 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:52.695771 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:52.898216 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:52.898182 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:52.994350 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:52.994277 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:53.091757 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:53.091726 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:53.624619 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:53.624571 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:53.727094 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:53.727052 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:57.200530 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:57.200500 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:57.439774 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:57.439744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:01:58.491286 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:01:58.491249 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:02:06.408659 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:06.408621 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:02:09.674283 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:09.674244 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:02:24.376948 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:24.376910 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:02:31.692326 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:31.692282 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:02:31.792392 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:31.792347 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:02:41.006847 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:41.006809 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:02:41.105835 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:41.105799 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:02:41.278264 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:41.278179 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:02:43.687169 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:43.687135 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:02:45.652716 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:45.652677 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:02:50.482413 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:02:50.482332 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:27.482007 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:27.481928 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:27.760294 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:27.760218 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:30.381204 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:30.381149 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:30.482484 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:30.482435 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:33.267549 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:33.267505 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:33.483144 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:33.483109 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:37.687345 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:37.687315 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:37.910236 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:37.910195 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:38.961206 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:38.961157 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:39.128273 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:39.128238 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:39.228857 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:39.228766 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:39.875271 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:39.875242 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:39.976828 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:39.976793 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:40.077868 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:40.077830 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:41.468454 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:41.468419 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:42.412665 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:42.412632 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:03:47.562065 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:47.562030 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:47.662767 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:47.662723 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:48.240017 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:48.239962 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:49.697262 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:49.697230 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:54.310889 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:54.310852 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:54.779759 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:54.779670 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:54.881422 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:54.881385 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:55.783343 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:55.783301 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:03:56.741254 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:56.741216 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:03:56.842183 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:03:56.842152 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:05.043129 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:05.043093 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:06.309888 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:06.309851 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:26.963185 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:26.963101 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:32.193165 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:32.193131 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:32.292891 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:32.292858 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:32.601747 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:32.601709 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:32.874344 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:32.874261 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:33.332354 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:33.332319 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:35.502283 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:35.502247 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:35.607890 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:35.607856 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:35.840133 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:35.840095 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:36.460161 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:36.460132 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:36.557512 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:36.557481 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:40.041693 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:40.041628 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:41.464248 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:41.464206 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:41.565072 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:41.565032 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:43.485829 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:43.485800 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:04:43.523010 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:43.522955 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:43.621230 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:43.621192 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:43.720911 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:43.720880 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:43.820564 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:43.820534 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:44.171717 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:44.171623 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:44.278185 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:44.278149 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:48.034959 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:48.034923 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:54.781052 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:54.781013 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:04:57.865455 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:57.865396 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:57.965241 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:57.965209 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:04:59.218081 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:04:59.218050 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:02.487577 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:02.487544 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:05:05.047478 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:05.047449 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:05.145276 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:05.145239 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:16.188962 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:16.188925 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:05:22.082367 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.082331 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66"] Jul 13 20:05:22.082746 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.082648 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" Jul 13 20:05:22.082746 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.082658 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" Jul 13 20:05:22.082746 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.082717 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" Jul 13 20:05:22.085663 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.085645 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.089556 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.089530 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6d9be2\"/\"openshift-service-ca.crt\"" Jul 13 20:05:22.089684 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.089583 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6d9be2\"/\"default-dockercfg-z8wzm\"" Jul 13 20:05:22.089684 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.089597 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6d9be2\"/\"kube-root-ca.crt\"" Jul 13 20:05:22.089684 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.089657 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6d9be2\"/\"test-model-6d9be2-kserve-self-signed-certs\"" Jul 13 20:05:22.097838 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.097818 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66"] Jul 13 20:05:22.152181 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.152137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tmp-dir\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.152340 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.152201 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-model-cache\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.152340 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.152307 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tls-certs\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.152435 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.152358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcl9r\" (UniqueName: \"kubernetes.io/projected/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-kube-api-access-tcl9r\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.152435 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.152420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-home\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.152511 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.152455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-dshm\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.186856 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.186800 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:22.253730 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.253694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-dshm\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.253730 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.253733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tmp-dir\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.253972 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.253751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-model-cache\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.253972 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.253805 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tls-certs\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.253972 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.253839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9r\" (UniqueName: \"kubernetes.io/projected/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-kube-api-access-tcl9r\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.253972 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.253882 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-home\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.254204 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.254149 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tmp-dir\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.254262 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.254243 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-model-cache\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.254304 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.254290 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-home\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.256264 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.256233 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-dshm\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.256499 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.256482 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tls-certs\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.262682 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.262660 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcl9r\" (UniqueName: \"kubernetes.io/projected/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-kube-api-access-tcl9r\") pod \"test-model-6d9be2-kserve-5b5c7f97fc-mpt66\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.395005 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.394893 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:22.529288 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.529223 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66"] Jul 13 20:05:22.532211 ip-10-0-134-100 kubenswrapper[2555]: W0713 20:05:22.532180 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod877b2f79_bf4d_4ca5_836f_ea979bbf5b4c.slice/crio-828d09907874bcd7ff65180f16408231fcfcea4e94009fff44dd58816b0bfab9 WatchSource:0}: Error finding container 828d09907874bcd7ff65180f16408231fcfcea4e94009fff44dd58816b0bfab9: Status 404 returned error can't find the container with id 828d09907874bcd7ff65180f16408231fcfcea4e94009fff44dd58816b0bfab9 Jul 13 20:05:22.863855 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.863819 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" event={"ID":"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c","Type":"ContainerStarted","Data":"6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74"} Jul 13 20:05:22.863855 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.863863 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" event={"ID":"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c","Type":"ContainerStarted","Data":"828d09907874bcd7ff65180f16408231fcfcea4e94009fff44dd58816b0bfab9"} Jul 13 20:05:22.885957 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:22.885913 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" podStartSLOduration=0.885901018 podStartE2EDuration="885.901018ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:05:22.884103274 +0000 UTC m=+2393.930657543" watchObservedRunningTime="2026-07-13 20:05:22.885901018 +0000 UTC m=+2393.932455287" Jul 13 20:05:23.429654 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:23.429622 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:26.481914 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:26.481878 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:05:29.659019 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:29.658993 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 20:05:29.666819 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:29.666799 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 20:05:32.395253 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:32.395214 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:32.395253 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:32.395255 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:32.407710 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:32.407686 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:32.921569 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:32.921539 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:05:41.783304 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:41.783266 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:05:47.571826 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:47.571792 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66"] Jul 13 20:05:48.879595 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:48.879556 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:48.939773 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:48.939736 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:58.086022 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:58.085891 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:05:59.778002 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:05:59.777931 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:06:02.592919 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.592846 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" podUID="877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" containerName="main" containerID="cri-o://6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74" gracePeriod=45 Jul 13 20:06:02.815781 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.815745 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:02.847171 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.847116 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:06:02.997033 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.996971 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-model-cache\") pod \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " Jul 13 20:06:02.997256 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997082 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tmp-dir\") pod \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " Jul 13 20:06:02.997256 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997123 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcl9r\" (UniqueName: \"kubernetes.io/projected/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-kube-api-access-tcl9r\") pod \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " Jul 13 20:06:02.997256 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997149 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tls-certs\") pod \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " Jul 13 20:06:02.997256 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997171 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-home\") pod \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " Jul 13 20:06:02.997256 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997205 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-dshm\") pod \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\" (UID: \"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c\") " Jul 13 20:06:02.997256 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997242 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-model-cache" (OuterVolumeSpecName: "model-cache") pod "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" (UID: "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:06:02.997615 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997355 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" (UID: "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:06:02.997615 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997505 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-model-cache\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:06:02.997615 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997524 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tmp-dir\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:06:02.997615 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.997520 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-home" (OuterVolumeSpecName: "home") pod "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" (UID: "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:06:02.999503 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.999480 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-dshm" (OuterVolumeSpecName: "dshm") pod "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" (UID: "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:06:02.999614 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.999553 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-kube-api-access-tcl9r" (OuterVolumeSpecName: "kube-api-access-tcl9r") pod "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" (UID: "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c"). InnerVolumeSpecName "kube-api-access-tcl9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:06:02.999614 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:02.999574 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" (UID: "877b2f79-bf4d-4ca5-836f-ea979bbf5b4c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:06:03.054785 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.054750 2555 generic.go:356] "Generic (PLEG): container finished" podID="877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" containerID="6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74" exitCode=0 Jul 13 20:06:03.054916 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.054793 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" Jul 13 20:06:03.054916 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.054804 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" event={"ID":"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c","Type":"ContainerDied","Data":"6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74"} Jul 13 20:06:03.054916 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.054844 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66" event={"ID":"877b2f79-bf4d-4ca5-836f-ea979bbf5b4c","Type":"ContainerDied","Data":"828d09907874bcd7ff65180f16408231fcfcea4e94009fff44dd58816b0bfab9"} Jul 13 20:06:03.054916 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.054862 2555 scope.go:117] "RemoveContainer" containerID="6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74" Jul 13 20:06:03.064328 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.064308 2555 scope.go:117] "RemoveContainer" containerID="6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74" Jul 13 20:06:03.064570 ip-10-0-134-100 kubenswrapper[2555]: E0713 20:06:03.064549 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74\": container with ID starting with 6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74 not found: ID does not exist" containerID="6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74" Jul 13 20:06:03.064617 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.064581 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74"} err="failed to get container status \"6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74\": rpc error: code = NotFound desc = could not find container \"6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74\": container with ID starting with 6d9eec71ecf478c6b3cc1396867ce761272c3513a1bca346a01c78995ed47e74 not found: ID does not exist" Jul 13 20:06:03.081970 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.081942 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66"] Jul 13 20:06:03.085373 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.085345 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6d9be2/test-model-6d9be2-kserve-5b5c7f97fc-mpt66"] Jul 13 20:06:03.098101 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.098053 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcl9r\" (UniqueName: \"kubernetes.io/projected/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-kube-api-access-tcl9r\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:06:03.098101 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.098071 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-tls-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:06:03.098101 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.098081 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-home\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:06:03.098101 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.098090 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c-dshm\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:06:03.549497 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:03.549473 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" path="/var/lib/kubelet/pods/877b2f79-bf4d-4ca5-836f-ea979bbf5b4c/volumes" Jul 13 20:06:09.627536 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:09.627502 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:09.727439 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:09.727406 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:10.526830 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:10.526796 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:06:11.289491 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:11.289456 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:13.466870 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:13.466837 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:13.703593 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:13.703563 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:14.496402 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:14.496375 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:14.611512 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:14.611477 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:24.253390 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:24.253358 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:27.476043 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:27.476009 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:06:28.900133 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:28.900098 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:34.674722 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:34.674662 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:34.755598 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:34.755542 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:39.621359 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:39.621325 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:39.856819 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:39.856781 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:40.199284 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:40.199247 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:40.521306 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:40.521212 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:41.989215 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:41.989178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:43.216936 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:43.216904 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:43.309443 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:43.309410 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:43.544323 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:43.544236 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:43.645150 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:43.645122 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:43.981456 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:43.981422 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:44.082191 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:44.082152 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:47.687290 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:47.687259 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:06:47.723087 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:47.723057 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:48.160919 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:48.160886 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:48.470751 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:48.470635 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:48.669442 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:48.669409 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:51.262252 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:51.262210 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:51.358325 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:51.358296 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:51.442390 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:51.442341 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:51.537357 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:51.537260 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:51.928326 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:51.928293 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:52.029775 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:52.029744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:55.765643 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:55.765602 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:06:59.779214 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:06:59.779170 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:07:04.690341 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:04.690302 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:04.788906 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:04.788871 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:13.002988 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:13.002951 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:13.112064 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:13.112018 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:14.366940 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:14.366895 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:14.468157 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:14.468113 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:14.625594 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:14.625493 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:18.374470 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:18.374433 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:07:18.925090 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:18.925059 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:24.723530 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:24.723420 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:24.793448 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:24.793417 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:29.599583 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:29.599550 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:29.849941 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:29.849839 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:30.775313 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:30.775284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:30.877026 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:30.876964 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:32.408814 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:32.408785 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:32.510476 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:32.510428 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:41.671215 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:41.671174 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:41.727565 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:41.727534 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:44.083169 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:44.083132 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:07:45.044326 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:45.044284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:50.783601 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:50.783549 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:50.843736 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:50.843703 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:55.752577 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:55.752544 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:55.970167 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:55.970130 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:56.353784 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:56.353751 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:56.750437 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:56.750343 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:57.030717 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:57.030612 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:59.645696 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:59.645657 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:07:59.726827 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:07:59.726792 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:00.284781 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:00.284747 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:00.342133 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:00.342094 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:04.149059 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:04.149016 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:04.292796 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:04.292768 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:08:04.509286 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:04.509199 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:04.861194 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:04.861162 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:05.064253 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:05.064219 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:07.766658 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:07.766614 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:07.864578 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:07.864547 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:08.074908 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:08.074879 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:08.247344 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:08.247313 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:09.107073 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:09.107043 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:09.202627 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:09.202601 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:12.205695 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:12.205668 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:15.580561 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:15.580524 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:08:22.222772 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:22.222730 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:22.324355 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:22.324316 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:27.106402 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:27.106369 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:29.864591 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:29.864552 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:30.459866 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:30.459836 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:08:30.775139 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:08:30.775058 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:09:18.394258 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.394218 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff"] Jul 13 20:09:18.394726 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.394711 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" containerName="main" Jul 13 20:09:18.394770 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.394730 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" containerName="main" Jul 13 20:09:18.394770 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.394750 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" Jul 13 20:09:18.394770 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.394760 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" Jul 13 20:09:18.394867 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.394855 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="877b2f79-bf4d-4ca5-836f-ea979bbf5b4c" containerName="main" Jul 13 20:09:18.394904 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.394867 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c86501b9-2289-475a-bb42-63bf755eb0fe" containerName="istio-proxy" Jul 13 20:09:18.398134 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.398104 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.402216 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.402187 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-641463\"/\"default-dockercfg-tlzg5\"" Jul 13 20:09:18.402500 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.402481 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-641463\"/\"auth-test-model-641463-kserve-self-signed-certs\"" Jul 13 20:09:18.402621 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.402561 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-641463\"/\"kube-root-ca.crt\"" Jul 13 20:09:18.402621 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.402545 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-641463\"/\"openshift-service-ca.crt\"" Jul 13 20:09:18.410539 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.410517 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff"] Jul 13 20:09:18.461281 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.461252 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-model-cache\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.461471 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.461285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-tmp-dir\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.461471 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.461313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmh9n\" (UniqueName: \"kubernetes.io/projected/352c2996-7b39-4806-8495-275c032b2a7e-kube-api-access-nmh9n\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.461471 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.461343 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-home\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.461471 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.461382 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-dshm\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.461471 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.461419 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/352c2996-7b39-4806-8495-275c032b2a7e-tls-certs\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.547028 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.546990 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:09:18.562052 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.562015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/352c2996-7b39-4806-8495-275c032b2a7e-tls-certs\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.562245 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.562062 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-model-cache\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.562245 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.562103 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-tmp-dir\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.562245 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.562146 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmh9n\" (UniqueName: \"kubernetes.io/projected/352c2996-7b39-4806-8495-275c032b2a7e-kube-api-access-nmh9n\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.562245 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.562190 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-home\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.562469 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.562351 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-dshm\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.562469 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.562440 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-model-cache\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.562580 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.562506 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-tmp-dir\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.562580 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.562562 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-home\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.564675 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.564638 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-dshm\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.564789 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.564749 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/352c2996-7b39-4806-8495-275c032b2a7e-tls-certs\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.570803 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.570783 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmh9n\" (UniqueName: \"kubernetes.io/projected/352c2996-7b39-4806-8495-275c032b2a7e-kube-api-access-nmh9n\") pod \"auth-test-model-641463-kserve-7fb6f4d4d7-hbmff\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.707949 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.707858 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:18.853041 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.853015 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff"] Jul 13 20:09:18.856072 ip-10-0-134-100 kubenswrapper[2555]: W0713 20:09:18.856049 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod352c2996_7b39_4806_8495_275c032b2a7e.slice/crio-d7457d4da6f6fd146ce8be354e437780de3259b7519af7cf2364187b94494889 WatchSource:0}: Error finding container d7457d4da6f6fd146ce8be354e437780de3259b7519af7cf2364187b94494889: Status 404 returned error can't find the container with id d7457d4da6f6fd146ce8be354e437780de3259b7519af7cf2364187b94494889 Jul 13 20:09:18.942635 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.942607 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" event={"ID":"352c2996-7b39-4806-8495-275c032b2a7e","Type":"ContainerStarted","Data":"940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c"} Jul 13 20:09:18.942776 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.942646 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" event={"ID":"352c2996-7b39-4806-8495-275c032b2a7e","Type":"ContainerStarted","Data":"d7457d4da6f6fd146ce8be354e437780de3259b7519af7cf2364187b94494889"} Jul 13 20:09:18.971419 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:18.971328 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" podStartSLOduration=0.971308412 podStartE2EDuration="971.308412ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:09:18.970054606 +0000 UTC m=+2630.016608890" watchObservedRunningTime="2026-07-13 20:09:18.971308412 +0000 UTC m=+2630.017862685" Jul 13 20:09:22.283171 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:22.283135 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:09:28.608570 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:28.608532 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:09:28.707994 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:28.707944 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:28.708154 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:28.708014 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:28.709241 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:28.709210 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:09:28.720787 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:28.720764 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:28.998434 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:28.998354 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:09:34.977660 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:34.977624 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:09:51.878391 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:09:51.878348 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:10:09.078065 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:10:09.078031 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:10:24.500103 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:10:24.500027 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:10:29.689260 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:10:29.689230 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 20:10:29.693419 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:10:29.693400 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 20:10:41.690293 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:10:41.690262 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:11:00.082909 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:00.082871 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:11:10.207529 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:10.207489 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:10.663398 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:10.663369 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:15.148772 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:15.148714 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:15.931966 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:15.931936 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff"] Jul 13 20:11:15.973873 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:15.973841 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:17.983646 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:17.983616 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:11:30.928331 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:30.928276 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:30.952416 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:30.952375 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" podUID="352c2996-7b39-4806-8495-275c032b2a7e" containerName="main" containerID="cri-o://940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c" gracePeriod=45 Jul 13 20:11:31.215077 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.215051 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:11:31.295086 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.295049 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-dshm\") pod \"352c2996-7b39-4806-8495-275c032b2a7e\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " Jul 13 20:11:31.295655 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.295103 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmh9n\" (UniqueName: \"kubernetes.io/projected/352c2996-7b39-4806-8495-275c032b2a7e-kube-api-access-nmh9n\") pod \"352c2996-7b39-4806-8495-275c032b2a7e\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " Jul 13 20:11:31.295655 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.295150 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-home\") pod \"352c2996-7b39-4806-8495-275c032b2a7e\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " Jul 13 20:11:31.295655 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.295195 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/352c2996-7b39-4806-8495-275c032b2a7e-tls-certs\") pod \"352c2996-7b39-4806-8495-275c032b2a7e\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " Jul 13 20:11:31.295655 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.295222 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-tmp-dir\") pod \"352c2996-7b39-4806-8495-275c032b2a7e\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " Jul 13 20:11:31.295655 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.295261 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-model-cache\") pod \"352c2996-7b39-4806-8495-275c032b2a7e\" (UID: \"352c2996-7b39-4806-8495-275c032b2a7e\") " Jul 13 20:11:31.295655 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.295452 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-home" (OuterVolumeSpecName: "home") pod "352c2996-7b39-4806-8495-275c032b2a7e" (UID: "352c2996-7b39-4806-8495-275c032b2a7e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:11:31.295655 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.295486 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "352c2996-7b39-4806-8495-275c032b2a7e" (UID: "352c2996-7b39-4806-8495-275c032b2a7e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:11:31.295655 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.295574 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-model-cache" (OuterVolumeSpecName: "model-cache") pod "352c2996-7b39-4806-8495-275c032b2a7e" (UID: "352c2996-7b39-4806-8495-275c032b2a7e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:11:31.297511 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.297490 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/352c2996-7b39-4806-8495-275c032b2a7e-kube-api-access-nmh9n" (OuterVolumeSpecName: "kube-api-access-nmh9n") pod "352c2996-7b39-4806-8495-275c032b2a7e" (UID: "352c2996-7b39-4806-8495-275c032b2a7e"). InnerVolumeSpecName "kube-api-access-nmh9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:11:31.297511 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.297506 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/352c2996-7b39-4806-8495-275c032b2a7e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "352c2996-7b39-4806-8495-275c032b2a7e" (UID: "352c2996-7b39-4806-8495-275c032b2a7e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:11:31.297671 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.297493 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-dshm" (OuterVolumeSpecName: "dshm") pod "352c2996-7b39-4806-8495-275c032b2a7e" (UID: "352c2996-7b39-4806-8495-275c032b2a7e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:11:31.396193 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.396152 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmh9n\" (UniqueName: \"kubernetes.io/projected/352c2996-7b39-4806-8495-275c032b2a7e-kube-api-access-nmh9n\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:11:31.396193 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.396184 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-home\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:11:31.396193 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.396194 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/352c2996-7b39-4806-8495-275c032b2a7e-tls-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:11:31.396193 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.396205 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-tmp-dir\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:11:31.396477 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.396213 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-model-cache\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:11:31.396477 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.396221 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/352c2996-7b39-4806-8495-275c032b2a7e-dshm\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:11:31.565224 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.565187 2555 generic.go:356] "Generic (PLEG): container finished" podID="352c2996-7b39-4806-8495-275c032b2a7e" containerID="940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c" exitCode=0 Jul 13 20:11:31.565386 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.565247 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" Jul 13 20:11:31.565386 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.565246 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" event={"ID":"352c2996-7b39-4806-8495-275c032b2a7e","Type":"ContainerDied","Data":"940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c"} Jul 13 20:11:31.565386 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.565352 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff" event={"ID":"352c2996-7b39-4806-8495-275c032b2a7e","Type":"ContainerDied","Data":"d7457d4da6f6fd146ce8be354e437780de3259b7519af7cf2364187b94494889"} Jul 13 20:11:31.565386 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.565373 2555 scope.go:117] "RemoveContainer" containerID="940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c" Jul 13 20:11:31.576132 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.576112 2555 scope.go:117] "RemoveContainer" containerID="940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c" Jul 13 20:11:31.576454 ip-10-0-134-100 kubenswrapper[2555]: E0713 20:11:31.576433 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c\": container with ID starting with 940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c not found: ID does not exist" containerID="940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c" Jul 13 20:11:31.576498 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.576465 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c"} err="failed to get container status \"940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c\": rpc error: code = NotFound desc = could not find container \"940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c\": container with ID starting with 940c23cef31d814fec9a8234936726aa8b859b14a92f27bbcf9c6eb16599731c not found: ID does not exist" Jul 13 20:11:31.585130 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.585100 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff"] Jul 13 20:11:31.588533 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:31.588507 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-641463/auth-test-model-641463-kserve-7fb6f4d4d7-hbmff"] Jul 13 20:11:33.550161 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:33.550128 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="352c2996-7b39-4806-8495-275c032b2a7e" path="/var/lib/kubelet/pods/352c2996-7b39-4806-8495-275c032b2a7e/volumes" Jul 13 20:11:35.377967 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:35.377934 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:11:49.430242 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:49.430207 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:49.531277 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:49.531242 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:11:53.482726 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:11:53.482693 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:12:28.187914 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:28.187875 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:12:33.127501 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:33.127467 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:33.224092 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:33.224061 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:45.207485 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:45.207446 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:12:51.519312 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:51.519275 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:51.616333 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:51.616299 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:52.450389 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:52.450349 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:53.171154 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:53.171097 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:56.308339 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.308301 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc"] Jul 13 20:12:56.308824 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.308665 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="352c2996-7b39-4806-8495-275c032b2a7e" containerName="main" Jul 13 20:12:56.308824 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.308678 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="352c2996-7b39-4806-8495-275c032b2a7e" containerName="main" Jul 13 20:12:56.308824 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.308739 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="352c2996-7b39-4806-8495-275c032b2a7e" containerName="main" Jul 13 20:12:56.311680 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.311659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.314742 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.314714 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"default-dockercfg-t52rd\"" Jul 13 20:12:56.316633 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.316607 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"rate-test-model-939152-kserve-self-signed-certs\"" Jul 13 20:12:56.316757 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.316670 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"kube-root-ca.crt\"" Jul 13 20:12:56.316757 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.316666 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"openshift-service-ca.crt\"" Jul 13 20:12:56.327643 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.327610 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc"] Jul 13 20:12:56.356051 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.356012 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:12:56.424940 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.424902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-home\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.425155 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.424962 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5ntl\" (UniqueName: \"kubernetes.io/projected/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-kube-api-access-w5ntl\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.425155 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.425049 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tls-certs\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.425155 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.425088 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-model-cache\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.425155 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.425112 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tmp-dir\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.425314 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.425162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-dshm\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.526506 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.526463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-home\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.526699 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.526526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5ntl\" (UniqueName: \"kubernetes.io/projected/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-kube-api-access-w5ntl\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.526699 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.526568 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tls-certs\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.526699 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.526598 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-model-cache\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.526699 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.526622 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tmp-dir\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.526699 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.526679 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-dshm\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.527008 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.526937 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-home\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.527110 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.527081 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tmp-dir\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.527331 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.527279 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-model-cache\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.529375 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.529351 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tls-certs\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.529464 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.529354 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-dshm\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.539524 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.539498 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5ntl\" (UniqueName: \"kubernetes.io/projected/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-kube-api-access-w5ntl\") pod \"rate-test-model-939152-kserve-597799fd5f-v22sc\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.621799 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.621697 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:12:56.763954 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.763919 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc"] Jul 13 20:12:56.766758 ip-10-0-134-100 kubenswrapper[2555]: W0713 20:12:56.766729 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8ea0118_eaa5_4b3d_9310_4a6eeedeae3d.slice/crio-12638a54edd33cddecaae81c243ab3dd3949158aceee3aa7255028f25f6a54e2 WatchSource:0}: Error finding container 12638a54edd33cddecaae81c243ab3dd3949158aceee3aa7255028f25f6a54e2: Status 404 returned error can't find the container with id 12638a54edd33cddecaae81c243ab3dd3949158aceee3aa7255028f25f6a54e2 Jul 13 20:12:56.959180 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.959092 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" event={"ID":"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d","Type":"ContainerStarted","Data":"22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a"} Jul 13 20:12:56.959180 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.959133 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" event={"ID":"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d","Type":"ContainerStarted","Data":"12638a54edd33cddecaae81c243ab3dd3949158aceee3aa7255028f25f6a54e2"} Jul 13 20:12:56.983374 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:12:56.983320 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" podStartSLOduration=0.983303303 podStartE2EDuration="983.303303ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:12:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:12:56.981573273 +0000 UTC m=+2848.028127572" watchObservedRunningTime="2026-07-13 20:12:56.983303303 +0000 UTC m=+2848.029857572" Jul 13 20:13:05.403095 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:05.403057 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:13:06.622037 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:06.621992 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:13:06.622037 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:06.622046 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:13:06.635760 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:06.635722 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:13:07.017461 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:07.017382 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:13:23.594820 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:23.594735 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:24.207615 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:24.207569 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:25.923752 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:25.923721 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:30.256266 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:30.256228 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:30.356638 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:30.356601 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:30.989837 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:30.989795 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:31.801215 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:31.801179 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:31.902615 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:31.902579 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:13:35.892621 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:35.892581 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:13:50.601683 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:13:50.601644 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:14:13.788755 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:13.788714 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:14:18.071364 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:18.071323 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc"] Jul 13 20:14:18.092306 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:18.092271 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:18.992128 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:18.992095 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:29.883330 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:29.883295 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:14:33.092060 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.092009 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" podUID="b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" containerName="main" containerID="cri-o://22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a" gracePeriod=45 Jul 13 20:14:33.343038 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.342944 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:14:33.398580 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.398543 2555 generic.go:356] "Generic (PLEG): container finished" podID="b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" containerID="22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a" exitCode=0 Jul 13 20:14:33.398747 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.398591 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" Jul 13 20:14:33.398747 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.398633 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" event={"ID":"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d","Type":"ContainerDied","Data":"22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a"} Jul 13 20:14:33.398747 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.398680 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc" event={"ID":"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d","Type":"ContainerDied","Data":"12638a54edd33cddecaae81c243ab3dd3949158aceee3aa7255028f25f6a54e2"} Jul 13 20:14:33.398747 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.398707 2555 scope.go:117] "RemoveContainer" containerID="22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a" Jul 13 20:14:33.406857 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.406839 2555 scope.go:117] "RemoveContainer" containerID="22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a" Jul 13 20:14:33.407140 ip-10-0-134-100 kubenswrapper[2555]: E0713 20:14:33.407116 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a\": container with ID starting with 22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a not found: ID does not exist" containerID="22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a" Jul 13 20:14:33.407216 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.407149 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a"} err="failed to get container status \"22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a\": rpc error: code = NotFound desc = could not find container \"22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a\": container with ID starting with 22788c05283138b523eb9c389b26114bc27be692f8f8dcf9c4f8f1b86a4c889a not found: ID does not exist" Jul 13 20:14:33.415420 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415406 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tmp-dir\") pod \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " Jul 13 20:14:33.415461 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415437 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5ntl\" (UniqueName: \"kubernetes.io/projected/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-kube-api-access-w5ntl\") pod \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " Jul 13 20:14:33.415461 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415458 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-home\") pod \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " Jul 13 20:14:33.415532 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415498 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-model-cache\") pod \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " Jul 13 20:14:33.415574 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415531 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tls-certs\") pod \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " Jul 13 20:14:33.415627 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415602 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-dshm\") pod \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\" (UID: \"b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d\") " Jul 13 20:14:33.415709 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415685 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" (UID: "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:14:33.415822 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415773 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-home" (OuterVolumeSpecName: "home") pod "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" (UID: "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:14:33.415822 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415823 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tmp-dir\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:14:33.416010 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.415823 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" (UID: "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:14:33.417837 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.417813 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-dshm" (OuterVolumeSpecName: "dshm") pod "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" (UID: "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 20:14:33.417924 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.417842 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-kube-api-access-w5ntl" (OuterVolumeSpecName: "kube-api-access-w5ntl") pod "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" (UID: "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d"). InnerVolumeSpecName "kube-api-access-w5ntl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 20:14:33.417924 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.417871 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" (UID: "b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 20:14:33.516256 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.516221 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-dshm\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:14:33.516256 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.516251 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5ntl\" (UniqueName: \"kubernetes.io/projected/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-kube-api-access-w5ntl\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:14:33.516256 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.516262 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-home\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:14:33.516497 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.516269 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-model-cache\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:14:33.516497 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.516278 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d-tls-certs\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\"" Jul 13 20:14:33.715727 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.715647 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc"] Jul 13 20:14:33.719000 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:33.718960 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-939152/rate-test-model-939152-kserve-597799fd5f-v22sc"] Jul 13 20:14:35.549687 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:35.549648 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" path="/var/lib/kubelet/pods/b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d/volumes" Jul 13 20:14:38.977888 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:38.977852 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:40.256143 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:40.256112 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:49.455006 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:49.454930 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:52.184753 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:52.184719 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:14:53.382268 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:53.382236 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:59.258403 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:59.258354 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:14:59.357924 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:14:59.357885 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:04.110723 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:04.110690 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:04.332410 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:04.332374 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:05.170407 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:05.170372 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:05.270586 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:05.270556 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:14.889138 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:14.889101 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:18.084242 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:18.084208 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hfgh4"] Jul 13 20:15:19.560571 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:19.560535 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:25.724811 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:25.724764 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:25.825789 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:25.825755 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:29.714242 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:29.714212 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 20:15:29.722101 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:29.722078 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 20:15:30.285186 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:30.285152 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:30.528117 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:30.528086 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:30.964077 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:30.964045 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-549fcbd77f-cdztp_f2b649f4-1e06-48e7-9eae-0fa95a582dd9/authorino/0.log" Jul 13 20:15:36.503918 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:36.503885 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699d4944b8-5kbzl_6b54f626-3ae1-466e-88e1-20f78c2e4809/copy-manifests/0.log" Jul 13 20:15:36.511179 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:36.511159 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699d4944b8-5kbzl_6b54f626-3ae1-466e-88e1-20f78c2e4809/manager/0.log" Jul 13 20:15:40.219171 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:40.219127 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-549fcbd77f-cdztp_f2b649f4-1e06-48e7-9eae-0fa95a582dd9/authorino/0.log" Jul 13 20:15:40.447118 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:40.447090 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d4cq2_b9aa4949-c632-478b-8b0a-655d7e3ff9f6/manager/0.log" Jul 13 20:15:40.670340 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:40.670297 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m92r6_6edca6c4-f75e-4bbb-a47d-1fd34fc174bb/registry-server/0.log" Jul 13 20:15:40.794763 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:40.794727 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kvzz2_f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9/manager/0.log" Jul 13 20:15:40.909260 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:40.909224 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hfgh4_c8b7216d-9442-4f90-9b57-99bf03de6613/limitador/0.log" Jul 13 20:15:41.388926 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:41.388895 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44s22c_a3a76269-d523-48de-9e62-2581756dce13/istio-proxy/0.log" Jul 13 20:15:41.854436 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:41.854407 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dlgfr_ea478e9b-3cbc-4909-bead-3f35b669a550/istio-proxy/1.log" Jul 13 20:15:42.809968 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:42.809937 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-brc25_1d2dcebb-5e27-4013-b143-4438556360c2/main/0.log" Jul 13 20:15:43.076800 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:43.076719 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-mmkjm_8a274c0d-41c0-42e2-878d-01e192a74e53/main/0.log" Jul 13 20:15:43.186821 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:43.186780 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-9llr5_76027c53-4e1e-490b-98e7-3d144b472753/main/0.log" Jul 13 20:15:47.659946 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:47.659901 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:47.754110 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:47.754080 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:50.406393 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:50.406362 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mc8s4_7f88c638-9d92-4e40-aa7f-620014bb4134/global-pull-secret-syncer/0.log" Jul 13 20:15:50.540841 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:50.540814 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" Jul 13 20:15:50.618467 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:50.618431 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-100.ec2.internal_154c5327aa16f9370b08bb6afc50c2f4/haproxy/0.log" Jul 13 20:15:55.429455 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:55.429422 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-549fcbd77f-cdztp_f2b649f4-1e06-48e7-9eae-0fa95a582dd9/authorino/0.log" Jul 13 20:15:55.487355 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:55.487328 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-d4cq2_b9aa4949-c632-478b-8b0a-655d7e3ff9f6/manager/0.log" Jul 13 20:15:55.554139 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:55.554107 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m92r6_6edca6c4-f75e-4bbb-a47d-1fd34fc174bb/registry-server/0.log" Jul 13 20:15:55.680110 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:55.680026 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kvzz2_f3f6cf27-1d6c-49df-bd4c-36d56bc7c9d9/manager/0.log" Jul 13 20:15:55.703423 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:55.703394 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hfgh4_c8b7216d-9442-4f90-9b57-99bf03de6613/limitador/0.log" Jul 13 20:15:57.815124 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:57.815091 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:57.916227 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:57.916194 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:15:57.943083 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:57.943061 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtzvg_ddfde8d1-c2f4-4563-b272-33a5f8bc7867/node-exporter/0.log" Jul 13 20:15:57.960901 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:57.960882 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtzvg_ddfde8d1-c2f4-4563-b272-33a5f8bc7867/kube-rbac-proxy/0.log" Jul 13 20:15:57.979732 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:57.979701 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gtzvg_ddfde8d1-c2f4-4563-b272-33a5f8bc7867/init-textfile/0.log" Jul 13 20:15:58.433575 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:58.433546 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-wldsb_4010ce8a-c7ff-4df0-a4b6-cb605edc257c/prometheus-operator/0.log" Jul 13 20:15:58.449290 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:15:58.449267 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-wldsb_4010ce8a-c7ff-4df0-a4b6-cb605edc257c/kube-rbac-proxy/0.log" Jul 13 20:16:01.105746 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:01.105716 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-z74j4_d2cc09df-1bf9-42b6-93ae-2861864d2182/download-server/0.log" Jul 13 20:16:02.264292 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.264255 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb"] Jul 13 20:16:02.264650 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.264599 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" containerName="main" Jul 13 20:16:02.264650 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.264609 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" containerName="main" Jul 13 20:16:02.264723 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.264667 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ea0118-eaa5-4b3d-9310-4a6eeedeae3d" containerName="main" Jul 13 20:16:02.267827 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.267803 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.270479 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.270461 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmgjw\"/\"openshift-service-ca.crt\"" Jul 13 20:16:02.271684 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.271667 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmgjw\"/\"kube-root-ca.crt\"" Jul 13 20:16:02.271792 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.271674 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mmgjw\"/\"default-dockercfg-tzzw6\"" Jul 13 20:16:02.279470 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.279448 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb"] Jul 13 20:16:02.354158 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.354130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-proc\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.354292 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.354184 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-podres\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.354292 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.354252 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-lib-modules\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.354292 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.354287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vgv6\" (UniqueName: \"kubernetes.io/projected/99a5c97b-397a-4464-83c9-54d141fc66b8-kube-api-access-6vgv6\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.354396 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.354316 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-sys\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.455663 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.455631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-proc\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.455818 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.455682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-podres\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.455818 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.455711 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-lib-modules\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.455818 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.455728 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgv6\" (UniqueName: \"kubernetes.io/projected/99a5c97b-397a-4464-83c9-54d141fc66b8-kube-api-access-6vgv6\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.455818 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.455749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-sys\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.455818 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.455759 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-proc\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.456026 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.455824 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-sys\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.456026 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.455873 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-podres\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.456026 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.455880 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99a5c97b-397a-4464-83c9-54d141fc66b8-lib-modules\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.464960 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.464940 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgv6\" (UniqueName: \"kubernetes.io/projected/99a5c97b-397a-4464-83c9-54d141fc66b8-kube-api-access-6vgv6\") pod \"perf-node-gather-daemonset-shmbb\" (UID: \"99a5c97b-397a-4464-83c9-54d141fc66b8\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.577835 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.577804 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:02.708206 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.708178 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb"] Jul 13 20:16:02.711925 ip-10-0-134-100 kubenswrapper[2555]: W0713 20:16:02.711897 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod99a5c97b_397a_4464_83c9_54d141fc66b8.slice/crio-d63f66cf1c613dfd8d84ba33420b6d4d44934265ac6578123fad61d1bd538c27 WatchSource:0}: Error finding container d63f66cf1c613dfd8d84ba33420b6d4d44934265ac6578123fad61d1bd538c27: Status 404 returned error can't find the container with id d63f66cf1c613dfd8d84ba33420b6d4d44934265ac6578123fad61d1bd538c27 Jul 13 20:16:02.801684 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.801649 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" event={"ID":"99a5c97b-397a-4464-83c9-54d141fc66b8","Type":"ContainerStarted","Data":"d63f66cf1c613dfd8d84ba33420b6d4d44934265ac6578123fad61d1bd538c27"} Jul 13 20:16:02.930667 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.930643 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8rl5_2bb1bdb8-3bab-44cd-a3fc-074213c9cd34/dns/0.log" Jul 13 20:16:02.952104 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:02.952083 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h8rl5_2bb1bdb8-3bab-44cd-a3fc-074213c9cd34/kube-rbac-proxy/0.log" Jul 13 20:16:03.013492 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:03.013465 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t877d_3a880dc9-d62a-455d-a46b-09e03d167960/dns-node-resolver/0.log" Jul 13 20:16:03.633992 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:03.633957 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m9wqk_75d81a4e-0023-445d-bbee-336e39407e8c/node-ca/0.log" Jul 13 20:16:03.807814 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:03.807774 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" event={"ID":"99a5c97b-397a-4464-83c9-54d141fc66b8","Type":"ContainerStarted","Data":"8f8d616dc64c362b15412f7f64aaf26499b0dc412f3650fbf9f57032e3986905"} Jul 13 20:16:03.808034 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:03.807859 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:03.825706 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:03.825661 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" podStartSLOduration=1.825641841 podStartE2EDuration="1.825641841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:16:03.823200139 +0000 UTC m=+3034.869754428" watchObservedRunningTime="2026-07-13 20:16:03.825641841 +0000 UTC m=+3034.872196111" Jul 13 20:16:04.615643 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:04.615609 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44s22c_a3a76269-d523-48de-9e62-2581756dce13/istio-proxy/0.log" Jul 13 20:16:04.824717 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:04.824681 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dlgfr_ea478e9b-3cbc-4909-bead-3f35b669a550/istio-proxy/0.log" Jul 13 20:16:04.853304 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:04.853274 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dlgfr_ea478e9b-3cbc-4909-bead-3f35b669a550/istio-proxy/1.log" Jul 13 20:16:05.590323 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:05.590294 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kg5n4_4b613bdc-4461-47c2-b357-b14b9aa599d4/serve-healthcheck-canary/0.log" Jul 13 20:16:06.181324 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:06.181298 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nkl7x_e467f89a-41e7-43dc-8fc6-f88a6335acb7/kube-rbac-proxy/0.log" Jul 13 20:16:06.209040 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:06.209019 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nkl7x_e467f89a-41e7-43dc-8fc6-f88a6335acb7/exporter/0.log" Jul 13 20:16:06.233610 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:06.233591 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nkl7x_e467f89a-41e7-43dc-8fc6-f88a6335acb7/extractor/0.log" Jul 13 20:16:08.798721 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:08.798689 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699d4944b8-5kbzl_6b54f626-3ae1-466e-88e1-20f78c2e4809/manager/0.log" Jul 13 20:16:08.817751 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:08.817725 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699d4944b8-5kbzl_6b54f626-3ae1-466e-88e1-20f78c2e4809/copy-manifests/0.log" Jul 13 20:16:09.822664 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:09.822634 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-shmbb" Jul 13 20:16:10.093512 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:10.093435 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75894cfc5c-p87lx_ed146606-7c76-4a29-82cf-362e266729f0/manager/0.log" Jul 13 20:16:10.138427 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:10.138394 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8nsdv_59fe1dbb-eee9-4244-b873-a6c2c10a216d/openshift-lws-operator/0.log" Jul 13 20:16:10.883061 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:10.883030 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44s22c_a3a76269-d523-48de-9e62-2581756dce13/istio-proxy/0.log" Jul 13 20:16:11.062275 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:11.062241 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dlgfr_ea478e9b-3cbc-4909-bead-3f35b669a550/istio-proxy/0.log" Jul 13 20:16:11.095621 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:11.095587 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dlgfr_ea478e9b-3cbc-4909-bead-3f35b669a550/istio-proxy/1.log" Jul 13 20:16:12.580899 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:12.580876 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf44s22c_a3a76269-d523-48de-9e62-2581756dce13/istio-proxy/0.log" Jul 13 20:16:12.738793 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:12.738753 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dlgfr_ea478e9b-3cbc-4909-bead-3f35b669a550/istio-proxy/0.log" Jul 13 20:16:12.767096 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:12.767067 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dlgfr_ea478e9b-3cbc-4909-bead-3f35b669a550/istio-proxy/1.log" Jul 13 20:16:13.090170 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:13.090136 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:16:13.190954 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:13.190920 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kntpt_82098306-9d22-4632-91bd-bc066d450d55/konnectivity-agent/0.log" limit=1024 Jul 13 20:16:17.253040 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.253014 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88hs_be85543b-0c22-425e-bc2b-0d5784529e5d/kube-multus-additional-cni-plugins/0.log" Jul 13 20:16:17.275003 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.274953 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88hs_be85543b-0c22-425e-bc2b-0d5784529e5d/egress-router-binary-copy/0.log" Jul 13 20:16:17.296513 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.296492 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88hs_be85543b-0c22-425e-bc2b-0d5784529e5d/cni-plugins/0.log" Jul 13 20:16:17.320965 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.320941 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88hs_be85543b-0c22-425e-bc2b-0d5784529e5d/bond-cni-plugin/0.log" Jul 13 20:16:17.344932 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.344913 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88hs_be85543b-0c22-425e-bc2b-0d5784529e5d/routeoverride-cni/0.log" Jul 13 20:16:17.367101 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.367082 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88hs_be85543b-0c22-425e-bc2b-0d5784529e5d/whereabouts-cni-bincopy/0.log" Jul 13 20:16:17.389073 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.389046 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88hs_be85543b-0c22-425e-bc2b-0d5784529e5d/whereabouts-cni/0.log" Jul 13 20:16:17.495946 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.495905 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wg8bt_f1c25a20-9a76-49e9-a5fe-b4ab031600d9/kube-multus/0.log" Jul 13 20:16:17.671577 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.671551 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm67z_9fa025d1-cdfb-41a5-80df-50795d7b36f9/network-metrics-daemon/0.log" Jul 13 20:16:17.696737 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:17.696708 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm67z_9fa025d1-cdfb-41a5-80df-50795d7b36f9/kube-rbac-proxy/0.log" Jul 13 20:16:18.561025 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:18.561002 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-controller/0.log" Jul 13 20:16:18.576643 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:18.576622 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/1.log" Jul 13 20:16:18.576789 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:18.576683 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovn-acl-logging/0.log" Jul 13 20:16:18.594644 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:18.594622 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/kube-rbac-proxy-node/0.log" Jul 13 20:16:18.614107 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:18.614089 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/kube-rbac-proxy-ovn-metrics/0.log" Jul 13 20:16:18.628468 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:18.628453 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/northd/0.log" Jul 13 20:16:18.649206 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:18.649184 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/nbdb/0.log" Jul 13 20:16:18.667228 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:18.667208 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/sbdb/0.log" Jul 13 20:16:18.716441 ip-10-0-134-100 kubenswrapper[2555]: I0713 20:16:18.716419 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hmw6r_35273a9e-cd1d-45ff-974f-1111d3941390/ovnkube-controller/0.log"