Jul 13 22:11:16.168121 ip-10-0-137-241 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 22:11:16.168133 ip-10-0-137-241 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 22:11:16.168140 ip-10-0-137-241 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 22:11:16.168385 ip-10-0-137-241 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 22:11:25.559075 ip-10-0-137-241 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 13 22:11:25.559089 ip-10-0-137-241 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cf0b7bbc9f604645b8a1996eeeca1cc2 -- Jul 13 22:13:15.289754 ip-10-0-137-241 systemd[1]: Starting Kubernetes Kubelet... Jul 13 22:13:15.668936 ip-10-0-137-241 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 22:13:15.668936 ip-10-0-137-241 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 22:13:15.668936 ip-10-0-137-241 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 22:13:15.668936 ip-10-0-137-241 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 22:13:15.668936 ip-10-0-137-241 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 22:13:15.671771 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.671666 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 22:13:15.676559 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676537 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:15.676559 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676558 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:15.676559 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676562 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676566 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676569 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676572 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676575 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676578 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676581 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676584 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676587 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676590 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676599 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676603 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676606 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676610 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676612 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676615 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676618 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676621 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676624 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676627 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:15.676674 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676630 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676633 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676636 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676639 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676642 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676645 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676648 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676650 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676653 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676656 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676659 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676662 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676665 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676667 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676671 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676674 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676677 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676681 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676684 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676687 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:15.677185 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676691 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676694 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676697 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676699 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676702 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676705 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676708 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676710 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676713 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676716 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676718 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676721 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676724 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676727 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676729 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676732 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676735 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676737 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676741 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676744 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:15.677744 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676746 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676749 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676752 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676756 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676759 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676761 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676765 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676767 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676770 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676773 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676775 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676779 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676782 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676785 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676787 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676790 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676793 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676796 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676798 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:15.678267 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676801 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676804 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676807 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676809 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676812 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676814 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676817 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676823 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676827 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676831 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676834 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676838 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676843 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676848 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676852 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676856 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676860 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.676863 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677743 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:15.678777 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677753 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677757 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677761 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677765 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677768 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677771 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677775 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677778 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677781 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677784 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677787 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677790 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677793 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677796 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677799 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677803 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677807 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677811 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677815 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:15.679280 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677818 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677821 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677824 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677827 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677830 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677833 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677836 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677838 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677842 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677845 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677848 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677853 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677856 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677859 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677862 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677865 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677868 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677871 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677874 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:15.679808 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677876 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677885 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677888 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677891 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677894 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677897 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677899 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677902 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677905 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677908 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677911 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677913 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677917 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677919 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677922 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677925 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677928 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677931 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677935 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677938 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:15.680316 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677941 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677944 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677947 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677951 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677954 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677963 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677967 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677969 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677972 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677975 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677978 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677980 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677983 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677986 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677989 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677991 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677994 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677997 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.677999 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678002 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:15.680862 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678005 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678007 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678010 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678015 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678018 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678021 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678024 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678027 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678029 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678032 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678035 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678038 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678041 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678043 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678047 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678050 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678053 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678055 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678065 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678068 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:15.681411 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678555 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678561 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678564 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678567 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678570 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678573 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678578 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678582 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678585 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678588 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678592 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678595 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678598 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678601 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678604 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678607 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678610 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678613 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678616 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678619 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:15.681960 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678622 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678625 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678628 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678630 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678633 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678636 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678639 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678642 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678644 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678647 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678657 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678660 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678663 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678666 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678668 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678671 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678674 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678677 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678679 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678682 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:15.682482 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678685 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678687 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678692 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678695 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678698 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678701 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678704 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678706 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678709 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678712 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678714 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678717 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678720 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678723 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678725 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678728 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678730 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678733 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678739 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678742 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:15.683053 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678745 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678748 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678751 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678760 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678763 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678766 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678768 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678771 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678774 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678777 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678779 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678782 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678785 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678788 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678791 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678794 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678797 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678799 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678802 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678805 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:15.683579 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678807 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678810 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678812 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678815 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678818 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678821 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678824 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678826 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678829 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678832 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678835 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678838 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678840 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678843 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678847 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678851 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678860 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678864 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.678867 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:15.684102 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.678952 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.678961 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.678973 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.678978 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.678983 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.678986 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.678991 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.678996 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.678999 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679002 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679006 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679009 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679013 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679016 2581 flags.go:64] FLAG: --cgroup-root="" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679019 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679022 2581 flags.go:64] FLAG: --client-ca-file="" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679025 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679028 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679035 2581 flags.go:64] FLAG: --cluster-domain="" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679038 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679042 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679045 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679048 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679053 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 22:13:15.684652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679057 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679060 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679064 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679068 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679071 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679074 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679084 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679087 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679092 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679095 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679098 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679101 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679104 2581 flags.go:64] FLAG: --enable-server="true" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679107 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679115 2581 flags.go:64] FLAG: --event-burst="100" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679118 2581 flags.go:64] FLAG: --event-qps="50" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679121 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679125 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679128 2581 flags.go:64] FLAG: --eviction-hard="" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679132 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679135 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679138 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679141 2581 flags.go:64] FLAG: --eviction-soft="" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679144 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679147 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 22:13:15.685272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679150 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679153 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679156 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679160 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679163 2581 flags.go:64] FLAG: --feature-gates="" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679167 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679170 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679173 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679177 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679181 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679184 2581 flags.go:64] FLAG: --help="false" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679187 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-137-241.ec2.internal" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679190 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679194 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679203 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679207 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679210 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679213 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679216 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679219 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679222 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679225 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679228 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679231 2581 flags.go:64] FLAG: --kube-reserved="" Jul 13 22:13:15.685986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679235 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679238 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679241 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679244 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679247 2581 flags.go:64] FLAG: --lock-file="" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679250 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679253 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679256 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679261 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679265 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679268 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679271 2581 flags.go:64] FLAG: --logging-format="text" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679274 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679278 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679282 2581 flags.go:64] FLAG: --manifest-url="" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679285 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679289 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679293 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679300 2581 flags.go:64] FLAG: --max-pods="110" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679303 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679321 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679325 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679329 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679338 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679342 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 22:13:15.686698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679345 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679352 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679356 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679359 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679362 2581 flags.go:64] FLAG: --pod-cidr="" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679365 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679372 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679375 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679378 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679382 2581 flags.go:64] FLAG: --port="10250" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679385 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679388 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-015ef2b3e23719038" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679392 2581 flags.go:64] FLAG: --qos-reserved="" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679395 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679399 2581 flags.go:64] FLAG: --register-node="true" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679402 2581 flags.go:64] FLAG: --register-with-taints="" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679405 2581 flags.go:64] FLAG: --registry-burst="10" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679409 2581 flags.go:64] FLAG: --registry-qps="5" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679413 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679416 2581 flags.go:64] FLAG: --reserved-memory="" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679420 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679423 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679426 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679429 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679439 2581 flags.go:64] FLAG: --runonce="false" Jul 13 22:13:15.687361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679444 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679447 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679450 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679454 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679457 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679460 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679471 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679474 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679477 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679481 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679484 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679487 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679490 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679506 2581 flags.go:64] FLAG: --system-cgroups="" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679509 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679515 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679519 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679522 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679530 2581 flags.go:64] FLAG: --tls-min-version="" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679533 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679536 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679539 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679542 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679545 2581 flags.go:64] FLAG: --v="2" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679549 2581 flags.go:64] FLAG: --version="false" Jul 13 22:13:15.688154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679555 2581 flags.go:64] FLAG: --vmodule="" Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679559 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.679563 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679740 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679745 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679749 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679752 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679756 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679759 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679762 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679764 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679768 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679770 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679773 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679783 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679786 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679789 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679791 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679796 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679800 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:15.689148 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679803 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679806 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679809 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679812 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679815 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679818 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679821 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679824 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679827 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679830 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679833 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679836 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679840 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679843 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679846 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679849 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679851 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679854 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679857 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679862 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:15.689932 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679865 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679867 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679870 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679873 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679876 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679879 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679882 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679891 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679894 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679897 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679900 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679903 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679905 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679908 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679911 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679914 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679916 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679919 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679922 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679924 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:15.690460 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679927 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679930 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679933 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679935 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679939 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679942 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679945 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679948 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679951 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679954 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679957 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679961 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679964 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679967 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679970 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679972 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679975 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679978 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679981 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:15.691071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679983 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679994 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.679998 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680001 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680004 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680007 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680010 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680013 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680016 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680019 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680022 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680025 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680028 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680031 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680034 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680037 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680039 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680046 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680050 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:15.691584 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680053 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680056 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680060 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.680063 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.680623 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.688558 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.688584 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.689171 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.689195 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689540 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689553 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689557 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689560 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689563 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689566 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:15.692079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689569 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689572 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689575 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689578 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689581 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689584 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689587 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689590 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689593 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689596 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689599 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689602 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689605 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689607 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689610 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689612 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689617 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689622 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689625 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:15.692483 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689630 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689634 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689638 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689641 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689644 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689648 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689652 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689655 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689658 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689661 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689664 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689667 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689670 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689673 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689676 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689679 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689682 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689684 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689687 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689690 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:15.693079 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689693 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689696 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689699 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689702 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689704 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689709 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689712 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689716 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689719 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689723 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689726 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689728 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689734 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689737 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689740 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689745 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689748 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689753 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689757 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689762 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:15.693617 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689765 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689769 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689772 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689775 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689778 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689781 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689784 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689787 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689789 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689792 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689795 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689798 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689801 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689803 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689806 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689809 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689812 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689815 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689818 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:15.694165 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689820 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689823 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689826 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689829 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689831 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689834 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689837 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689840 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689843 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689846 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689850 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689853 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689856 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689859 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.689861 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:15.694822 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.689868 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690003 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690008 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690011 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690016 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690020 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690023 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690027 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690030 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690032 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690035 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690038 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690041 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690044 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690047 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690049 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690052 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690055 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690058 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690061 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 22:13:15.695232 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690064 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690066 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690069 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690072 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690076 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690079 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690082 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690084 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690088 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690091 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690093 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690096 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690099 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690102 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690105 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690107 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690110 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690113 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690115 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690118 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 22:13:15.695761 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690121 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690124 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690126 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690129 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690132 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690134 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690138 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690141 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690143 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690146 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690149 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690152 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690155 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690158 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690160 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690163 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690167 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690171 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690173 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690176 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 22:13:15.696379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690180 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690183 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690186 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690189 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690191 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690194 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690197 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690200 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690202 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690205 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690208 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690211 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690215 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690218 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690222 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690225 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690228 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690231 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690234 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690238 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 22:13:15.696923 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690241 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690245 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690247 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690250 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690253 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690257 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690260 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690263 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690265 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690268 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690272 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690274 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690278 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690281 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690284 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690287 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690290 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690292 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690295 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 22:13:15.697466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:15.690298 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 22:13:15.697999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.690303 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 22:13:15.697999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.690454 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 22:13:15.697999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.692595 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 22:13:15.697999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.693802 2581 server.go:1019] "Starting client certificate rotation" Jul 13 22:13:15.697999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.693908 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 22:13:15.697999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.693946 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 22:13:15.697999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.696004 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 22:13:15.697999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.697288 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 22:13:15.707917 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.707893 2581 log.go:25] "Validated CRI v1 runtime API" Jul 13 22:13:15.711958 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.711934 2581 log.go:25] "Validated CRI v1 image API" Jul 13 22:13:15.715183 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.715160 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 22:13:15.718386 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.718358 2581 fs.go:135] Filesystem UUIDs: map[1a1bbbf0-109f-470b-8151-bbd5120b7fa4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b1b94164-4ada-44a4-9ac9-1c6a7cb2cd16:/dev/nvme0n1p3] Jul 13 22:13:15.718485 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.718386 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 22:13:15.725994 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.725860 2581 manager.go:216] Machine: {Timestamp:2026-07-13 22:13:15.724547528 +0000 UTC m=+0.327823748 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100418 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec221e33a71526c625d063a62e596d59 SystemUUID:ec221e33-a715-26c6-25d0-63a62e596d59 BootID:cf0b7bbc-9f60-4645-b8a1-996eeeca1cc2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:06:84:94:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:06:84:94:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:4f:a1:b6:7f:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 22:13:15.725994 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.725991 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 22:13:15.726116 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.726095 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 22:13:15.728980 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.728937 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 22:13:15.729180 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.728982 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 22:13:15.729781 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.729762 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 22:13:15.730094 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.730079 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 22:13:15.730148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.730101 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 22:13:15.730148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.730115 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 22:13:15.730783 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.730767 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 22:13:15.731572 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.731560 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 22:13:15.734256 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.734238 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 13 22:13:15.734438 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.734426 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 22:13:15.734517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.734473 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 13 22:13:15.734517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.734490 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 22:13:15.734622 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.734532 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 22:13:15.734622 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.734547 2581 kubelet.go:398] "Adding apiserver pod source" Jul 13 22:13:15.734622 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.734560 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 22:13:15.735033 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.735018 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 22:13:15.735155 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.735044 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 22:13:15.738297 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.738058 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 22:13:15.739637 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.739622 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 22:13:15.739703 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.739655 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 22:13:15.740207 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740196 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 22:13:15.740244 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740212 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 22:13:15.740244 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740219 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 22:13:15.740244 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740225 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 22:13:15.740244 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740234 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 22:13:15.740244 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740240 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 22:13:15.740476 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740467 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 22:13:15.740526 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740476 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 22:13:15.740526 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740484 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 22:13:15.740526 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740490 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 22:13:15.740526 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740516 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 22:13:15.740526 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.740525 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 22:13:15.741285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.741272 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 22:13:15.741285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.741284 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 22:13:15.744868 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.744852 2581 server.go:1268] "Started kubelet" Jul 13 22:13:15.745011 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.744974 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 22:13:15.745120 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.744949 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 22:13:15.745120 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.745074 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 22:13:15.745924 ip-10-0-137-241 systemd[1]: Started Kubernetes Kubelet. Jul 13 22:13:15.746352 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.746182 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 22:13:15.747689 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.747673 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 13 22:13:15.749162 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.749139 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 22:13:15.749270 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.749247 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 22:13:15.749322 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.749247 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 22:13:15.750185 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.750164 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 22:13:15.751420 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.751403 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 22:13:15.751537 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.751429 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 22:13:15.751593 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.751530 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:15.752115 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.751912 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 22:13:15.752115 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.751933 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 22:13:15.752115 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.751956 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 22:13:15.752115 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.752078 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 13 22:13:15.752115 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.752089 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 13 22:13:15.752419 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.752362 2581 factory.go:55] Registering systemd factory Jul 13 22:13:15.752419 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.752379 2581 factory.go:223] Registration of the systemd container factory successfully Jul 13 22:13:15.752654 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.752625 2581 factory.go:153] Registering CRI-O factory Jul 13 22:13:15.752654 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.752648 2581 factory.go:223] Registration of the crio container factory successfully Jul 13 22:13:15.752826 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.752707 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 22:13:15.752826 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.752731 2581 factory.go:103] Registering Raw factory Jul 13 22:13:15.752826 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.752747 2581 manager.go:1196] Started watching for new ooms in manager Jul 13 22:13:15.753734 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.753713 2581 manager.go:349] Starting recovery of all containers Jul 13 22:13:15.753981 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.753954 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 22:13:15.754119 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.754095 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 22:13:15.755059 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.754000 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-241.ec2.internal.18c1f914f07d185b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-241.ec2.internal,UID:ip-10-0-137-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-241.ec2.internal,},FirstTimestamp:2026-07-13 22:13:15.744819291 +0000 UTC m=+0.348095511,LastTimestamp:2026-07-13 22:13:15.744819291 +0000 UTC m=+0.348095511,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-241.ec2.internal,}" Jul 13 22:13:15.761903 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.761660 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 22:13:15.767040 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.767011 2581 manager.go:354] Recovery completed Jul 13 22:13:15.772810 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.772794 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:15.775196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.775174 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:15.775278 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.775209 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:15.775278 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.775220 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:15.775871 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.775856 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 22:13:15.775871 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.775869 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:15.775973 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.775868 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 22:13:15.775973 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.775910 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 13 22:13:15.776703 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.776682 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:15.776757 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.776720 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:15.776757 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.776735 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:15.777178 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.777165 2581 policy_none.go:49] "None policy: Start" Jul 13 22:13:15.777219 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.777183 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 22:13:15.777219 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.777194 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 22:13:15.778036 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.777939 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-241.ec2.internal.18c1f914f24c957f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-241.ec2.internal,UID:ip-10-0-137-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-241.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-241.ec2.internal,},FirstTimestamp:2026-07-13 22:13:15.775194495 +0000 UTC m=+0.378470718,LastTimestamp:2026-07-13 22:13:15.775194495 +0000 UTC m=+0.378470718,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-241.ec2.internal,}" Jul 13 22:13:15.778129 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.778117 2581 policy_none.go:47] "Start" Jul 13 22:13:15.790069 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.789975 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-241.ec2.internal.18c1f914f24ce2a5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-241.ec2.internal,UID:ip-10-0-137-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-241.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-241.ec2.internal,},FirstTimestamp:2026-07-13 22:13:15.775214245 +0000 UTC m=+0.378490466,LastTimestamp:2026-07-13 22:13:15.775214245 +0000 UTC m=+0.378490466,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-241.ec2.internal,}" Jul 13 22:13:15.796728 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.796697 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dqlqj" Jul 13 22:13:15.804006 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.803928 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-241.ec2.internal.18c1f914f24d0bc8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-241.ec2.internal,UID:ip-10-0-137-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-241.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-241.ec2.internal,},FirstTimestamp:2026-07-13 22:13:15.775224776 +0000 UTC m=+0.378500996,LastTimestamp:2026-07-13 22:13:15.775224776 +0000 UTC m=+0.378500996,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-241.ec2.internal,}" Jul 13 22:13:15.806096 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.806073 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dqlqj" Jul 13 22:13:15.815242 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.815225 2581 manager.go:337] "Starting Device Plugin manager" Jul 13 22:13:15.815313 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.815272 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 22:13:15.815313 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.815291 2581 server.go:87] "Starting device plugin registration server" Jul 13 22:13:15.815624 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.815610 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 22:13:15.815666 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.815626 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 22:13:15.815759 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.815737 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 22:13:15.815862 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.815840 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 22:13:15.815862 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.815860 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 22:13:15.816485 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.816458 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 22:13:15.816568 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.816528 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:15.900757 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.900722 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 22:13:15.902027 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.900771 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 22:13:15.902027 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.900796 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 22:13:15.902027 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.900830 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 22:13:15.903823 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.903802 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:15.916581 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.916548 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:15.917794 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.917764 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:15.917924 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.917807 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:15.917924 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.917823 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:15.917924 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.917849 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-241.ec2.internal" Jul 13 22:13:15.928959 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:15.928890 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-241.ec2.internal" Jul 13 22:13:15.928959 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.928925 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-241.ec2.internal\": node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:15.978906 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:15.978872 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.001807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.001770 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal"] Jul 13 22:13:16.001968 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.001854 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:16.002905 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.002886 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:16.002997 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.002920 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:16.002997 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.002930 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:16.004300 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.004286 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:16.004459 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.004414 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.004508 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.004478 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:16.005100 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.005081 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:16.005170 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.005109 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:16.005170 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.005121 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:16.005170 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.005090 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:16.005266 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.005188 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:16.005266 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.005203 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:16.006566 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.006551 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.006654 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.006580 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:16.007835 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.007817 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:16.007944 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.007848 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:16.007944 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.007861 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:16.031500 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.031467 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-241.ec2.internal\" not found" node="ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.036379 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.036357 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-241.ec2.internal\" not found" node="ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.054159 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.054129 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef573e1d9b4e86c4d808d0e7390f3758-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal\" (UID: \"ef573e1d9b4e86c4d808d0e7390f3758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.054259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.054162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef573e1d9b4e86c4d808d0e7390f3758-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal\" (UID: \"ef573e1d9b4e86c4d808d0e7390f3758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.054259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.054181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61ba569156a29f0398951f103cb13f1d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-241.ec2.internal\" (UID: \"61ba569156a29f0398951f103cb13f1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.078977 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.078937 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.154692 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.154654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61ba569156a29f0398951f103cb13f1d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-241.ec2.internal\" (UID: \"61ba569156a29f0398951f103cb13f1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.154886 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.154715 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61ba569156a29f0398951f103cb13f1d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-241.ec2.internal\" (UID: \"61ba569156a29f0398951f103cb13f1d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.154886 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.154774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef573e1d9b4e86c4d808d0e7390f3758-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal\" (UID: \"ef573e1d9b4e86c4d808d0e7390f3758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.154886 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.154811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef573e1d9b4e86c4d808d0e7390f3758-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal\" (UID: \"ef573e1d9b4e86c4d808d0e7390f3758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.154886 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.154849 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef573e1d9b4e86c4d808d0e7390f3758-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal\" (UID: \"ef573e1d9b4e86c4d808d0e7390f3758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.154886 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.154856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef573e1d9b4e86c4d808d0e7390f3758-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal\" (UID: \"ef573e1d9b4e86c4d808d0e7390f3758\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.180139 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.180072 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.282043 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.282008 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.337441 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.337391 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.339653 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.339634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal" Jul 13 22:13:16.383387 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.383350 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.485042 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.484933 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.586082 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.586043 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.613169 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.613133 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:16.687155 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.687105 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.689740 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.689722 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:16.693142 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.693122 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 22:13:16.693297 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.693273 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 22:13:16.693340 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.693305 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 22:13:16.693340 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.693314 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 22:13:16.788198 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.788151 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.809363 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.809315 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 22:08:16 +0000 UTC" deadline="2028-02-12 08:26:15.079138079 +0000 UTC" Jul 13 22:13:16.809363 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.809358 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13882h12m58.269784935s" Jul 13 22:13:16.888387 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.888351 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:16.891706 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:16.891661 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef573e1d9b4e86c4d808d0e7390f3758.slice/crio-5e46581b6d8b95ea653cecdf5d49cfac2e53d3558dea72abc85988916ecb3e78 WatchSource:0}: Error finding container 5e46581b6d8b95ea653cecdf5d49cfac2e53d3558dea72abc85988916ecb3e78: Status 404 returned error can't find the container with id 5e46581b6d8b95ea653cecdf5d49cfac2e53d3558dea72abc85988916ecb3e78 Jul 13 22:13:16.891943 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:16.891921 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ba569156a29f0398951f103cb13f1d.slice/crio-e730a17947fad75a7ea6777b2ac6fc65f663ccd9273c93aae56c29816590fde7 WatchSource:0}: Error finding container e730a17947fad75a7ea6777b2ac6fc65f663ccd9273c93aae56c29816590fde7: Status 404 returned error can't find the container with id e730a17947fad75a7ea6777b2ac6fc65f663ccd9273c93aae56c29816590fde7 Jul 13 22:13:16.897088 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.897069 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 22:13:16.904621 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.904571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal" event={"ID":"61ba569156a29f0398951f103cb13f1d","Type":"ContainerStarted","Data":"e730a17947fad75a7ea6777b2ac6fc65f663ccd9273c93aae56c29816590fde7"} Jul 13 22:13:16.905655 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.905631 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" event={"ID":"ef573e1d9b4e86c4d808d0e7390f3758","Type":"ContainerStarted","Data":"5e46581b6d8b95ea653cecdf5d49cfac2e53d3558dea72abc85988916ecb3e78"} Jul 13 22:13:16.950988 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.950939 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 22:13:16.953254 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.953226 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientMemory" Jul 13 22:13:16.953377 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.953263 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 22:13:16.953377 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:16.953273 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeHasSufficientPID" Jul 13 22:13:16.989842 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:16.989807 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-241.ec2.internal\" not found" Jul 13 22:13:17.005075 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.005052 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:17.053213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.053135 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal" Jul 13 22:13:17.063870 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.063839 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 22:13:17.064855 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.064836 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" Jul 13 22:13:17.078727 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.078704 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 22:13:17.736051 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.736016 2581 apiserver.go:52] "Watching apiserver" Jul 13 22:13:17.742402 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.742371 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 22:13:17.743711 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.743676 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-grfc9","kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc","openshift-cluster-node-tuning-operator/tuned-v4mtl","openshift-dns/node-resolver-5tw9l","openshift-image-registry/node-ca-lnd6b","openshift-multus/multus-k9b8w","openshift-multus/network-metrics-daemon-8fp6d","kube-system/global-pull-secret-syncer-cvb5k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal","openshift-multus/multus-additional-cni-plugins-kgmrv","openshift-network-diagnostics/network-check-target-vpxg5","openshift-network-operator/iptables-alerter-flnln","openshift-ovn-kubernetes/ovnkube-node-vskgc"] Jul 13 22:13:17.745183 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.745161 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.746742 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.746716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.747488 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.747468 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 22:13:17.747488 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.747478 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 22:13:17.747646 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.747468 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 22:13:17.747738 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.747727 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 22:13:17.749013 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.748128 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wxjkw\"" Jul 13 22:13:17.749986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.749965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.752355 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.750995 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6vmvl\"" Jul 13 22:13:17.752355 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.751196 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 22:13:17.752355 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.751387 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:13:17.752355 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.751587 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 22:13:17.752355 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.752048 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 22:13:17.752680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.752502 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 22:13:17.753076 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.753049 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 22:13:17.753410 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.753219 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 22:13:17.753964 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.753626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.754455 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.754371 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-47lqv\"" Jul 13 22:13:17.755134 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.755100 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.756739 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.756207 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.757911 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6c546\"" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.758032 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.758120 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.758366 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.758388 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.758570 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.758637 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.758663 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.758847 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.758891 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 22:13:17.759374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.759081 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f69c6\"" Jul 13 22:13:17.762985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.761190 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:17.762985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.762144 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lxtpf\"" Jul 13 22:13:17.763946 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.763922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.766178 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766158 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7fllz\"" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-socket-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-sys-fs\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-kubernetes\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766579 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-host\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-socket-dir-parent\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-var-lib-kubelet\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-conf-dir\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-device-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.766776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-sysconfig\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6a7daea-2e87-48f1-92ff-c0620625b00b-host-slash\") pod \"iptables-alerter-flnln\" (UID: \"e6a7daea-2e87-48f1-92ff-c0620625b00b\") " pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766849 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-registration-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766913 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-cnibin\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-hostroot\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.766970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-run-k8s-cni-cncf-io\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdktf\" (UniqueName: \"kubernetes.io/projected/5491dbeb-ab6d-4214-80b9-8b1712fe7227-kube-api-access-gdktf\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04dfaae9-20cf-4c61-adb2-9cd582eb1038-tmp\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-etc-selinux\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-sysctl-conf\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.767335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-sys\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.767953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767342 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 22:13:17.767953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767501 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 22:13:17.767953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-lib-modules\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.767953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-os-release\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.767953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-var-lib-cni-bin\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.767975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nclk9\" (UniqueName: \"kubernetes.io/projected/e6a7daea-2e87-48f1-92ff-c0620625b00b-kube-api-access-nclk9\") pod \"iptables-alerter-flnln\" (UID: \"e6a7daea-2e87-48f1-92ff-c0620625b00b\") " pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-modprobe-d\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768032 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-var-lib-kubelet\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-tuned\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-cni-dir\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768120 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-run-multus-certs\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-etc-kubernetes\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-run\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzcnr\" (UniqueName: \"kubernetes.io/projected/04dfaae9-20cf-4c61-adb2-9cd582eb1038-kube-api-access-mzcnr\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-system-cni-dir\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768268 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5491dbeb-ab6d-4214-80b9-8b1712fe7227-cni-binary-copy\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.768318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-daemon-config\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.768922 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6a7daea-2e87-48f1-92ff-c0620625b00b-iptables-alerter-script\") pod \"iptables-alerter-flnln\" (UID: \"e6a7daea-2e87-48f1-92ff-c0620625b00b\") " pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.768922 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77tlc\" (UniqueName: \"kubernetes.io/projected/02e41b7e-5396-42f9-962e-77b0a2fb6705-kube-api-access-77tlc\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.768922 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-sysctl-d\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.768922 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-systemd\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.768922 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-run-netns\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.768922 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.768512 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-var-lib-cni-multus\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.770338 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.770316 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:17.770477 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.770432 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:17.773419 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.773084 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 22:13:17.773419 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.773205 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 22:13:17.773419 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.773319 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 22:13:17.773715 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.773683 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 22:13:17.773973 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.773954 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 22:13:17.774154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.774132 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 22:13:17.774225 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.774174 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ltgb7\"" Jul 13 22:13:17.775095 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.775071 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.777195 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.777083 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:17.777195 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.777154 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:17.777716 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.777695 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f9dgc\"" Jul 13 22:13:17.777984 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.777965 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 22:13:17.778069 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.777966 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 22:13:17.805010 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.804979 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mzvpk" Jul 13 22:13:17.812254 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.812231 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mzvpk" Jul 13 22:13:17.854117 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.854083 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 22:13:17.869031 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.868985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-socket-dir-parent\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869031 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-var-lib-kubelet\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-var-lib-openvswitch\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869090 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-node-log\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-sysconfig\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2afd7034-1a80-40a3-9ecb-fce5b0e9536a-serviceca\") pod \"node-ca-lnd6b\" (UID: \"2afd7034-1a80-40a3-9ecb-fce5b0e9536a\") " pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869150 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-socket-dir-parent\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869156 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-var-lib-kubelet\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2901cbd-37b2-4230-9412-77025b60a56e-ovnkube-config\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869219 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-sysconfig\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.869290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-cnibin\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-etc-openvswitch\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n6mp\" (UniqueName: \"kubernetes.io/projected/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-kube-api-access-8n6mp\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-run-netns\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-etc-selinux\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-sysctl-conf\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869395 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-cnibin\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-lib-modules\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869465 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-etc-selinux\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-os-release\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-var-lib-cni-bin\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-run-multus-certs\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-lib-modules\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869592 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-run-multus-certs\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869599 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-os-release\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d3dfbe4-1786-4e15-aa28-b0854769ddca-tmp-dir\") pod \"node-resolver-5tw9l\" (UID: \"3d3dfbe4-1786-4e15-aa28-b0854769ddca\") " pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.869858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869603 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-sysctl-conf\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869636 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-var-lib-cni-bin\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f05950a-68e3-4846-af4d-99d2b0eb778d-agent-certs\") pod \"konnectivity-agent-grfc9\" (UID: \"4f05950a-68e3-4846-af4d-99d2b0eb778d\") " pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nclk9\" (UniqueName: \"kubernetes.io/projected/e6a7daea-2e87-48f1-92ff-c0620625b00b-kube-api-access-nclk9\") pod \"iptables-alerter-flnln\" (UID: \"e6a7daea-2e87-48f1-92ff-c0620625b00b\") " pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-tuned\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-etc-kubernetes\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f05950a-68e3-4846-af4d-99d2b0eb778d-konnectivity-ca\") pod \"konnectivity-agent-grfc9\" (UID: \"4f05950a-68e3-4846-af4d-99d2b0eb778d\") " pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869834 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-etc-kubernetes\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-cni-bin\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-run\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzcnr\" (UniqueName: \"kubernetes.io/projected/04dfaae9-20cf-4c61-adb2-9cd582eb1038-kube-api-access-mzcnr\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-system-cni-dir\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-daemon-config\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869977 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-run\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.869993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-os-release\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870043 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-system-cni-dir\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.870713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-systemd-units\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-run-netns\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870140 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-var-lib-cni-multus\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-run-netns\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkzkw\" (UniqueName: \"kubernetes.io/projected/52ce273b-88d0-4597-9a08-4e59ccf7820d-kube-api-access-gkzkw\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870108 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-socket-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870271 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-var-lib-cni-multus\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-sys-fs\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-kubernetes\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-host\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-conf-dir\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-socket-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eec1a835-7c98-41a2-971f-39390a54adf3-dbus\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2901cbd-37b2-4230-9412-77025b60a56e-ovnkube-script-lib\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870474 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-sys-fs\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-device-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.871582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870518 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-host\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870541 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-kubernetes\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-conf-dir\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6a7daea-2e87-48f1-92ff-c0620625b00b-host-slash\") pod \"iptables-alerter-flnln\" (UID: \"e6a7daea-2e87-48f1-92ff-c0620625b00b\") " pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-device-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6a7daea-2e87-48f1-92ff-c0620625b00b-host-slash\") pod \"iptables-alerter-flnln\" (UID: \"e6a7daea-2e87-48f1-92ff-c0620625b00b\") " pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-registration-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870712 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-daemon-config\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-hostroot\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870744 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02e41b7e-5396-42f9-962e-77b0a2fb6705-registration-dir\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eec1a835-7c98-41a2-971f-39390a54adf3-kubelet-config\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-hostroot\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870889 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqgk7\" (UniqueName: \"kubernetes.io/projected/2afd7034-1a80-40a3-9ecb-fce5b0e9536a-kube-api-access-sqgk7\") pod \"node-ca-lnd6b\" (UID: \"2afd7034-1a80-40a3-9ecb-fce5b0e9536a\") " pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-slash\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-run-openvswitch\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.872454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-run-k8s-cni-cncf-io\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.870998 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdktf\" (UniqueName: \"kubernetes.io/projected/5491dbeb-ab6d-4214-80b9-8b1712fe7227-kube-api-access-gdktf\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-system-cni-dir\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-host-run-k8s-cni-cncf-io\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871050 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-cnibin\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-run-ovn\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871174 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2901cbd-37b2-4230-9412-77025b60a56e-env-overrides\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871199 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04dfaae9-20cf-4c61-adb2-9cd582eb1038-tmp\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-sys\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-log-socket\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-cni-netd\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2901cbd-37b2-4230-9412-77025b60a56e-ovn-node-metrics-cert\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn7ng\" (UniqueName: \"kubernetes.io/projected/d2901cbd-37b2-4230-9412-77025b60a56e-kube-api-access-hn7ng\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.873327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d3dfbe4-1786-4e15-aa28-b0854769ddca-hosts-file\") pod \"node-resolver-5tw9l\" (UID: \"3d3dfbe4-1786-4e15-aa28-b0854769ddca\") " pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871402 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-modprobe-d\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-var-lib-kubelet\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-cni-dir\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-run-systemd\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5491dbeb-ab6d-4214-80b9-8b1712fe7227-cni-binary-copy\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871621 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-kubelet\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6a7daea-2e87-48f1-92ff-c0620625b00b-iptables-alerter-script\") pod \"iptables-alerter-flnln\" (UID: \"e6a7daea-2e87-48f1-92ff-c0620625b00b\") " pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77tlc\" (UniqueName: \"kubernetes.io/projected/02e41b7e-5396-42f9-962e-77b0a2fb6705-kube-api-access-77tlc\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-sysctl-d\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-systemd\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gvdx\" (UniqueName: \"kubernetes.io/projected/3d3dfbe4-1786-4e15-aa28-b0854769ddca-kube-api-access-5gvdx\") pod \"node-resolver-5tw9l\" (UID: \"3d3dfbe4-1786-4e15-aa28-b0854769ddca\") " pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2afd7034-1a80-40a3-9ecb-fce5b0e9536a-host\") pod \"node-ca-lnd6b\" (UID: \"2afd7034-1a80-40a3-9ecb-fce5b0e9536a\") " pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.871908 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-sys\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.874148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.872044 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-modprobe-d\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.875061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.872090 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-var-lib-kubelet\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.875061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.872141 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5491dbeb-ab6d-4214-80b9-8b1712fe7227-multus-cni-dir\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.875061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.872648 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5491dbeb-ab6d-4214-80b9-8b1712fe7227-cni-binary-copy\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.875061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.872849 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-systemd\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.875061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.873190 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-sysctl-d\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.875061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.873686 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6a7daea-2e87-48f1-92ff-c0620625b00b-iptables-alerter-script\") pod \"iptables-alerter-flnln\" (UID: \"e6a7daea-2e87-48f1-92ff-c0620625b00b\") " pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.875604 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.875581 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04dfaae9-20cf-4c61-adb2-9cd582eb1038-tmp\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.875790 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.875769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04dfaae9-20cf-4c61-adb2-9cd582eb1038-etc-tuned\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.880166 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.880130 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nclk9\" (UniqueName: \"kubernetes.io/projected/e6a7daea-2e87-48f1-92ff-c0620625b00b-kube-api-access-nclk9\") pod \"iptables-alerter-flnln\" (UID: \"e6a7daea-2e87-48f1-92ff-c0620625b00b\") " pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:17.881486 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.881428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzcnr\" (UniqueName: \"kubernetes.io/projected/04dfaae9-20cf-4c61-adb2-9cd582eb1038-kube-api-access-mzcnr\") pod \"tuned-v4mtl\" (UID: \"04dfaae9-20cf-4c61-adb2-9cd582eb1038\") " pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:17.883662 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.883637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77tlc\" (UniqueName: \"kubernetes.io/projected/02e41b7e-5396-42f9-962e-77b0a2fb6705-kube-api-access-77tlc\") pod \"aws-ebs-csi-driver-node-jnmfc\" (UID: \"02e41b7e-5396-42f9-962e-77b0a2fb6705\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:17.883778 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.883718 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdktf\" (UniqueName: \"kubernetes.io/projected/5491dbeb-ab6d-4214-80b9-8b1712fe7227-kube-api-access-gdktf\") pod \"multus-k9b8w\" (UID: \"5491dbeb-ab6d-4214-80b9-8b1712fe7227\") " pod="openshift-multus/multus-k9b8w" Jul 13 22:13:17.943686 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.943646 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972205 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eec1a835-7c98-41a2-971f-39390a54adf3-kubelet-config\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972296 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqgk7\" (UniqueName: \"kubernetes.io/projected/2afd7034-1a80-40a3-9ecb-fce5b0e9536a-kube-api-access-sqgk7\") pod \"node-ca-lnd6b\" (UID: \"2afd7034-1a80-40a3-9ecb-fce5b0e9536a\") " pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-slash\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-run-openvswitch\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-system-cni-dir\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972402 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-cnibin\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-run-ovn\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2901cbd-37b2-4230-9412-77025b60a56e-env-overrides\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-log-socket\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-cni-netd\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2901cbd-37b2-4230-9412-77025b60a56e-ovn-node-metrics-cert\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972613 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eec1a835-7c98-41a2-971f-39390a54adf3-kubelet-config\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:17.973533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn7ng\" (UniqueName: \"kubernetes.io/projected/d2901cbd-37b2-4230-9412-77025b60a56e-kube-api-access-hn7ng\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d3dfbe4-1786-4e15-aa28-b0854769ddca-hosts-file\") pod \"node-resolver-5tw9l\" (UID: \"3d3dfbe4-1786-4e15-aa28-b0854769ddca\") " pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972754 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-run-systemd\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.972801 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-kubelet\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972873 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-slash\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.972880 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret podName:eec1a835-7c98-41a2-971f-39390a54adf3 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:18.472852481 +0000 UTC m=+3.076128709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret") pod "global-pull-secret-syncer-cvb5k" (UID: "eec1a835-7c98-41a2-971f-39390a54adf3") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-run-openvswitch\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.972965 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-system-cni-dir\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973007 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-cnibin\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d3dfbe4-1786-4e15-aa28-b0854769ddca-hosts-file\") pod \"node-resolver-5tw9l\" (UID: \"3d3dfbe4-1786-4e15-aa28-b0854769ddca\") " pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.973133 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973200 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-run-systemd\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973377 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.974555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973424 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-kubelet\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973478 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-cni-netd\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973542 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-log-socket\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973832 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-run-ovn\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.973885 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974345 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2901cbd-37b2-4230-9412-77025b60a56e-env-overrides\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.974423 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs podName:52ce273b-88d0-4597-9a08-4e59ccf7820d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:18.474404023 +0000 UTC m=+3.077680238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs") pod "network-metrics-daemon-8fp6d" (UID: "52ce273b-88d0-4597-9a08-4e59ccf7820d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gvdx\" (UniqueName: \"kubernetes.io/projected/3d3dfbe4-1786-4e15-aa28-b0854769ddca-kube-api-access-5gvdx\") pod \"node-resolver-5tw9l\" (UID: \"3d3dfbe4-1786-4e15-aa28-b0854769ddca\") " pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2afd7034-1a80-40a3-9ecb-fce5b0e9536a-host\") pod \"node-ca-lnd6b\" (UID: \"2afd7034-1a80-40a3-9ecb-fce5b0e9536a\") " pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-var-lib-openvswitch\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974574 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-node-log\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2afd7034-1a80-40a3-9ecb-fce5b0e9536a-serviceca\") pod \"node-ca-lnd6b\" (UID: \"2afd7034-1a80-40a3-9ecb-fce5b0e9536a\") " pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2901cbd-37b2-4230-9412-77025b60a56e-ovnkube-config\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-etc-openvswitch\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n6mp\" (UniqueName: \"kubernetes.io/projected/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-kube-api-access-8n6mp\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-run-netns\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.975484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d3dfbe4-1786-4e15-aa28-b0854769ddca-tmp-dir\") pod \"node-resolver-5tw9l\" (UID: \"3d3dfbe4-1786-4e15-aa28-b0854769ddca\") " pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f05950a-68e3-4846-af4d-99d2b0eb778d-agent-certs\") pod \"konnectivity-agent-grfc9\" (UID: \"4f05950a-68e3-4846-af4d-99d2b0eb778d\") " pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f05950a-68e3-4846-af4d-99d2b0eb778d-konnectivity-ca\") pod \"konnectivity-agent-grfc9\" (UID: \"4f05950a-68e3-4846-af4d-99d2b0eb778d\") " pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-cni-bin\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-os-release\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.974980 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-systemd-units\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.975010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkzkw\" (UniqueName: \"kubernetes.io/projected/52ce273b-88d0-4597-9a08-4e59ccf7820d-kube-api-access-gkzkw\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.975042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eec1a835-7c98-41a2-971f-39390a54adf3-dbus\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.975087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2901cbd-37b2-4230-9412-77025b60a56e-ovnkube-script-lib\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.975117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.975702 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.976316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.976287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d3dfbe4-1786-4e15-aa28-b0854769ddca-tmp-dir\") pod \"node-resolver-5tw9l\" (UID: \"3d3dfbe4-1786-4e15-aa28-b0854769ddca\") " pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.976349 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2afd7034-1a80-40a3-9ecb-fce5b0e9536a-host\") pod \"node-ca-lnd6b\" (UID: \"2afd7034-1a80-40a3-9ecb-fce5b0e9536a\") " pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.976391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-var-lib-openvswitch\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.976429 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-node-log\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.976714 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.976782 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-etc-openvswitch\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.976871 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2afd7034-1a80-40a3-9ecb-fce5b0e9536a-serviceca\") pod \"node-ca-lnd6b\" (UID: \"2afd7034-1a80-40a3-9ecb-fce5b0e9536a\") " pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.977154 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-run-netns\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.977223 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2901cbd-37b2-4230-9412-77025b60a56e-ovnkube-config\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.977243 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-os-release\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.977287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-run-ovn-kubernetes\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.977330 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-host-cni-bin\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.977767 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f05950a-68e3-4846-af4d-99d2b0eb778d-konnectivity-ca\") pod \"konnectivity-agent-grfc9\" (UID: \"4f05950a-68e3-4846-af4d-99d2b0eb778d\") " pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.977958 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2901cbd-37b2-4230-9412-77025b60a56e-ovnkube-script-lib\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.978009 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2901cbd-37b2-4230-9412-77025b60a56e-systemd-units\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.978736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.978017 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eec1a835-7c98-41a2-971f-39390a54adf3-dbus\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:17.979486 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.979093 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2901cbd-37b2-4230-9412-77025b60a56e-ovn-node-metrics-cert\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.981032 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.980970 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:17.981032 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.981000 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:17.981032 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.981016 2581 projected.go:196] Error preparing data for projected volume kube-api-access-q2l7f for pod openshift-network-diagnostics/network-check-target-vpxg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:17.981252 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:17.981084 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f podName:b45ee4ea-8111-4745-9e66-4c1034f6f643 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:18.481061844 +0000 UTC m=+3.084338058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q2l7f" (UniqueName: "kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f") pod "network-check-target-vpxg5" (UID: "b45ee4ea-8111-4745-9e66-4c1034f6f643") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:17.982816 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.982793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f05950a-68e3-4846-af4d-99d2b0eb778d-agent-certs\") pod \"konnectivity-agent-grfc9\" (UID: \"4f05950a-68e3-4846-af4d-99d2b0eb778d\") " pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:17.984047 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.984016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn7ng\" (UniqueName: \"kubernetes.io/projected/d2901cbd-37b2-4230-9412-77025b60a56e-kube-api-access-hn7ng\") pod \"ovnkube-node-vskgc\" (UID: \"d2901cbd-37b2-4230-9412-77025b60a56e\") " pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:17.984975 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.984949 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqgk7\" (UniqueName: \"kubernetes.io/projected/2afd7034-1a80-40a3-9ecb-fce5b0e9536a-kube-api-access-sqgk7\") pod \"node-ca-lnd6b\" (UID: \"2afd7034-1a80-40a3-9ecb-fce5b0e9536a\") " pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:17.989648 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.989242 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gvdx\" (UniqueName: \"kubernetes.io/projected/3d3dfbe4-1786-4e15-aa28-b0854769ddca-kube-api-access-5gvdx\") pod \"node-resolver-5tw9l\" (UID: \"3d3dfbe4-1786-4e15-aa28-b0854769ddca\") " pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:17.992384 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.992356 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkzkw\" (UniqueName: \"kubernetes.io/projected/52ce273b-88d0-4597-9a08-4e59ccf7820d-kube-api-access-gkzkw\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:17.994856 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:17.994831 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n6mp\" (UniqueName: \"kubernetes.io/projected/a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5-kube-api-access-8n6mp\") pod \"multus-additional-cni-plugins-kgmrv\" (UID: \"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5\") " pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:18.064226 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.064184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9b8w" Jul 13 22:13:18.076636 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.076600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-flnln" Jul 13 22:13:18.094131 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.094090 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" Jul 13 22:13:18.101804 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.101755 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" Jul 13 22:13:18.109536 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.109504 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5tw9l" Jul 13 22:13:18.119050 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.119014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lnd6b" Jul 13 22:13:18.126709 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.126666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:18.134489 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.134453 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:18.141050 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.141025 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" Jul 13 22:13:18.169374 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:18.169343 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e41b7e_5396_42f9_962e_77b0a2fb6705.slice/crio-91d179a51d5dc4b144f1e2b99ac9228df88cb1e1b23c0de64f907af4348f1fdf WatchSource:0}: Error finding container 91d179a51d5dc4b144f1e2b99ac9228df88cb1e1b23c0de64f907af4348f1fdf: Status 404 returned error can't find the container with id 91d179a51d5dc4b144f1e2b99ac9228df88cb1e1b23c0de64f907af4348f1fdf Jul 13 22:13:18.170466 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:18.170408 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04dfaae9_20cf_4c61_adb2_9cd582eb1038.slice/crio-40153b47064ebea1c9014b9af3ed1e9b90b47a3b6f22b0708180db492b5947b3 WatchSource:0}: Error finding container 40153b47064ebea1c9014b9af3ed1e9b90b47a3b6f22b0708180db492b5947b3: Status 404 returned error can't find the container with id 40153b47064ebea1c9014b9af3ed1e9b90b47a3b6f22b0708180db492b5947b3 Jul 13 22:13:18.171196 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:18.171150 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5491dbeb_ab6d_4214_80b9_8b1712fe7227.slice/crio-4f2b7d695d46792391bbae3fcb29036b25a6c7192b964a5539b330bca2555057 WatchSource:0}: Error finding container 4f2b7d695d46792391bbae3fcb29036b25a6c7192b964a5539b330bca2555057: Status 404 returned error can't find the container with id 4f2b7d695d46792391bbae3fcb29036b25a6c7192b964a5539b330bca2555057 Jul 13 22:13:18.194663 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:18.194634 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a344b5_ba10_4a7e_8a5a_e64e5d2ad5a5.slice/crio-e9079cdd24132f2557bd41290679d17edbe01334be3d732ac52c1dcbbc8575a0 WatchSource:0}: Error finding container e9079cdd24132f2557bd41290679d17edbe01334be3d732ac52c1dcbbc8575a0: Status 404 returned error can't find the container with id e9079cdd24132f2557bd41290679d17edbe01334be3d732ac52c1dcbbc8575a0 Jul 13 22:13:18.196130 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:18.196107 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f05950a_68e3_4846_af4d_99d2b0eb778d.slice/crio-22c64b84bbe91a8bc8cb874429d1d0887f949107609775ff5adef37246f86025 WatchSource:0}: Error finding container 22c64b84bbe91a8bc8cb874429d1d0887f949107609775ff5adef37246f86025: Status 404 returned error can't find the container with id 22c64b84bbe91a8bc8cb874429d1d0887f949107609775ff5adef37246f86025 Jul 13 22:13:18.196898 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:18.196812 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a7daea_2e87_48f1_92ff_c0620625b00b.slice/crio-7ede696bbf9d97a09038abf5182633ca97578d657419317c01d195858c863a09 WatchSource:0}: Error finding container 7ede696bbf9d97a09038abf5182633ca97578d657419317c01d195858c863a09: Status 404 returned error can't find the container with id 7ede696bbf9d97a09038abf5182633ca97578d657419317c01d195858c863a09 Jul 13 22:13:18.197724 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:18.197701 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3dfbe4_1786_4e15_aa28_b0854769ddca.slice/crio-8543accef79edeb1163c5283de2cd9d8c60651b808298b25f6b6a4b8c26d936b WatchSource:0}: Error finding container 8543accef79edeb1163c5283de2cd9d8c60651b808298b25f6b6a4b8c26d936b: Status 404 returned error can't find the container with id 8543accef79edeb1163c5283de2cd9d8c60651b808298b25f6b6a4b8c26d936b Jul 13 22:13:18.198939 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:18.198907 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2901cbd_37b2_4230_9412_77025b60a56e.slice/crio-11a7ebbff62d967a66e28b80b149623585a307b39395b256dcbf23d2f85df829 WatchSource:0}: Error finding container 11a7ebbff62d967a66e28b80b149623585a307b39395b256dcbf23d2f85df829: Status 404 returned error can't find the container with id 11a7ebbff62d967a66e28b80b149623585a307b39395b256dcbf23d2f85df829 Jul 13 22:13:18.199848 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:18.199828 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2afd7034_1a80_40a3_9ecb_fce5b0e9536a.slice/crio-5ca194f6d14bd6370d5f371b785ed391f2520f8461e1db3f5d141cf52033423d WatchSource:0}: Error finding container 5ca194f6d14bd6370d5f371b785ed391f2520f8461e1db3f5d141cf52033423d: Status 404 returned error can't find the container with id 5ca194f6d14bd6370d5f371b785ed391f2520f8461e1db3f5d141cf52033423d Jul 13 22:13:18.331675 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.331638 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:18.479722 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.479689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:18.479722 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.479735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:18.479954 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:18.479843 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:18.479954 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:18.479862 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:18.479954 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:18.479910 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs podName:52ce273b-88d0-4597-9a08-4e59ccf7820d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:19.479890327 +0000 UTC m=+4.083166535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs") pod "network-metrics-daemon-8fp6d" (UID: "52ce273b-88d0-4597-9a08-4e59ccf7820d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:18.479954 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:18.479928 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret podName:eec1a835-7c98-41a2-971f-39390a54adf3 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:19.479920384 +0000 UTC m=+4.083196591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret") pod "global-pull-secret-syncer-cvb5k" (UID: "eec1a835-7c98-41a2-971f-39390a54adf3") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:18.580780 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.580743 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:18.580965 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:18.580936 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:18.581023 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:18.580968 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:18.581023 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:18.580989 2581 projected.go:196] Error preparing data for projected volume kube-api-access-q2l7f for pod openshift-network-diagnostics/network-check-target-vpxg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:18.581102 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:18.581046 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f podName:b45ee4ea-8111-4745-9e66-4c1034f6f643 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:19.581031265 +0000 UTC m=+4.184307476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2l7f" (UniqueName: "kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f") pod "network-check-target-vpxg5" (UID: "b45ee4ea-8111-4745-9e66-4c1034f6f643") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:18.814592 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.814475 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 22:08:18 +0000 UTC" deadline="2028-02-02 09:48:23.967469976 +0000 UTC" Jul 13 22:13:18.814592 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.814516 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13643h35m5.152959612s" Jul 13 22:13:18.878615 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.878569 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 22:13:18.902027 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.901992 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:18.902208 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:18.902112 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:18.911852 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.911811 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lnd6b" event={"ID":"2afd7034-1a80-40a3-9ecb-fce5b0e9536a","Type":"ContainerStarted","Data":"5ca194f6d14bd6370d5f371b785ed391f2520f8461e1db3f5d141cf52033423d"} Jul 13 22:13:18.915952 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.915911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" event={"ID":"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5","Type":"ContainerStarted","Data":"e9079cdd24132f2557bd41290679d17edbe01334be3d732ac52c1dcbbc8575a0"} Jul 13 22:13:18.917673 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.917640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-grfc9" event={"ID":"4f05950a-68e3-4846-af4d-99d2b0eb778d","Type":"ContainerStarted","Data":"22c64b84bbe91a8bc8cb874429d1d0887f949107609775ff5adef37246f86025"} Jul 13 22:13:18.919485 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.919455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9b8w" event={"ID":"5491dbeb-ab6d-4214-80b9-8b1712fe7227","Type":"ContainerStarted","Data":"4f2b7d695d46792391bbae3fcb29036b25a6c7192b964a5539b330bca2555057"} Jul 13 22:13:18.922622 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.922592 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef573e1d9b4e86c4d808d0e7390f3758" containerID="e9bb2626950f6a8a5acc8a08256063e36975f927171285c5a878fbfee3934f02" exitCode=0 Jul 13 22:13:18.922744 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.922675 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" event={"ID":"ef573e1d9b4e86c4d808d0e7390f3758","Type":"ContainerDied","Data":"e9bb2626950f6a8a5acc8a08256063e36975f927171285c5a878fbfee3934f02"} Jul 13 22:13:18.925381 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.925316 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerStarted","Data":"11a7ebbff62d967a66e28b80b149623585a307b39395b256dcbf23d2f85df829"} Jul 13 22:13:18.933382 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.932066 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5tw9l" event={"ID":"3d3dfbe4-1786-4e15-aa28-b0854769ddca","Type":"ContainerStarted","Data":"8543accef79edeb1163c5283de2cd9d8c60651b808298b25f6b6a4b8c26d936b"} Jul 13 22:13:18.934258 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.934188 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-flnln" event={"ID":"e6a7daea-2e87-48f1-92ff-c0620625b00b","Type":"ContainerStarted","Data":"7ede696bbf9d97a09038abf5182633ca97578d657419317c01d195858c863a09"} Jul 13 22:13:18.937857 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.936632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" event={"ID":"04dfaae9-20cf-4c61-adb2-9cd582eb1038","Type":"ContainerStarted","Data":"40153b47064ebea1c9014b9af3ed1e9b90b47a3b6f22b0708180db492b5947b3"} Jul 13 22:13:18.938894 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:18.938866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" event={"ID":"02e41b7e-5396-42f9-962e-77b0a2fb6705","Type":"ContainerStarted","Data":"91d179a51d5dc4b144f1e2b99ac9228df88cb1e1b23c0de64f907af4348f1fdf"} Jul 13 22:13:19.491314 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.490454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:19.491314 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.490529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:19.491314 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.490673 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:19.491314 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.490739 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs podName:52ce273b-88d0-4597-9a08-4e59ccf7820d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:21.490718861 +0000 UTC m=+6.093995072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs") pod "network-metrics-daemon-8fp6d" (UID: "52ce273b-88d0-4597-9a08-4e59ccf7820d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:19.491314 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.491161 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:19.491314 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.491217 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret podName:eec1a835-7c98-41a2-971f-39390a54adf3 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:21.491200755 +0000 UTC m=+6.094476969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret") pod "global-pull-secret-syncer-cvb5k" (UID: "eec1a835-7c98-41a2-971f-39390a54adf3") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:19.592547 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.591862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:19.592547 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.592111 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:19.592547 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.592135 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:19.592547 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.592148 2581 projected.go:196] Error preparing data for projected volume kube-api-access-q2l7f for pod openshift-network-diagnostics/network-check-target-vpxg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:19.592547 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.592211 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f podName:b45ee4ea-8111-4745-9e66-4c1034f6f643 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:21.592192562 +0000 UTC m=+6.195468772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2l7f" (UniqueName: "kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f") pod "network-check-target-vpxg5" (UID: "b45ee4ea-8111-4745-9e66-4c1034f6f643") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:19.815392 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.815305 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 22:08:18 +0000 UTC" deadline="2028-04-17 08:51:07.424598862 +0000 UTC" Jul 13 22:13:19.815392 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.815373 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15442h37m47.609229854s" Jul 13 22:13:19.902769 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.902690 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:19.902992 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.902829 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:19.903553 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.903245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:19.903553 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:19.903348 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:19.976122 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.976077 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal" event={"ID":"61ba569156a29f0398951f103cb13f1d","Type":"ContainerStarted","Data":"32b5b8d438da48069d809a55326f3d2b05235d6e238edd3a06c75e6196a8b7a9"} Jul 13 22:13:19.991845 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.991809 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" event={"ID":"ef573e1d9b4e86c4d808d0e7390f3758","Type":"ContainerStarted","Data":"02f23f9c30463393337b23c2ad25c778a765900efad1bb9b90db9ab742b4c1d7"} Jul 13 22:13:19.992031 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:19.991943 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-241.ec2.internal" podStartSLOduration=2.991922744 podStartE2EDuration="2.991922744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:19.991381992 +0000 UTC m=+4.594658225" watchObservedRunningTime="2026-07-13 22:13:19.991922744 +0000 UTC m=+4.595198976" Jul 13 22:13:20.901501 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:20.900976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:20.901501 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:20.901113 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:21.513178 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:21.512495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:21.513178 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:21.512554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:21.513178 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.512692 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:21.513178 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.512761 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs podName:52ce273b-88d0-4597-9a08-4e59ccf7820d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:25.512742753 +0000 UTC m=+10.116018964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs") pod "network-metrics-daemon-8fp6d" (UID: "52ce273b-88d0-4597-9a08-4e59ccf7820d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:21.513178 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.512822 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:21.513178 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.512855 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret podName:eec1a835-7c98-41a2-971f-39390a54adf3 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:25.512843076 +0000 UTC m=+10.116119287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret") pod "global-pull-secret-syncer-cvb5k" (UID: "eec1a835-7c98-41a2-971f-39390a54adf3") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:21.613964 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:21.613898 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:21.614184 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.614070 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:21.614184 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.614089 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:21.614184 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.614103 2581 projected.go:196] Error preparing data for projected volume kube-api-access-q2l7f for pod openshift-network-diagnostics/network-check-target-vpxg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:21.614184 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.614164 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f podName:b45ee4ea-8111-4745-9e66-4c1034f6f643 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:25.614145505 +0000 UTC m=+10.217421712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2l7f" (UniqueName: "kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f") pod "network-check-target-vpxg5" (UID: "b45ee4ea-8111-4745-9e66-4c1034f6f643") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:21.901285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:21.901190 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:21.901475 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.901448 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:21.901570 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:21.901473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:21.901909 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:21.901578 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:22.901748 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:22.901289 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:22.901748 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:22.901443 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:23.901185 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:23.901114 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:23.901334 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:23.901122 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:23.901334 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:23.901233 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:23.901474 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:23.901399 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:24.901006 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:24.900951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:24.901570 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:24.901120 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:25.546154 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:25.546116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:25.546321 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:25.546168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:25.546321 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.546268 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:25.546321 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.546310 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:25.546520 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.546330 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret podName:eec1a835-7c98-41a2-971f-39390a54adf3 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:33.546310405 +0000 UTC m=+18.149586614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret") pod "global-pull-secret-syncer-cvb5k" (UID: "eec1a835-7c98-41a2-971f-39390a54adf3") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:25.546520 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.546347 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs podName:52ce273b-88d0-4597-9a08-4e59ccf7820d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:33.546337761 +0000 UTC m=+18.149613966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs") pod "network-metrics-daemon-8fp6d" (UID: "52ce273b-88d0-4597-9a08-4e59ccf7820d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:25.647437 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:25.647390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:25.647624 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.647546 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:25.647624 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.647565 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:25.647624 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.647574 2581 projected.go:196] Error preparing data for projected volume kube-api-access-q2l7f for pod openshift-network-diagnostics/network-check-target-vpxg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:25.647769 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.647634 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f podName:b45ee4ea-8111-4745-9e66-4c1034f6f643 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:33.647615409 +0000 UTC m=+18.250891615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2l7f" (UniqueName: "kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f") pod "network-check-target-vpxg5" (UID: "b45ee4ea-8111-4745-9e66-4c1034f6f643") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:25.903100 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:25.902653 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:25.903100 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.902765 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:25.903608 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:25.903111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:25.903608 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:25.903210 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:26.901351 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:26.901087 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:26.901351 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:26.901235 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:27.901787 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:27.901755 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:27.902213 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:27.901885 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:27.902213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:27.902101 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:27.902408 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:27.902224 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:28.901849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:28.901820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:28.902204 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:28.901928 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:29.901130 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:29.901100 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:29.901334 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:29.901100 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:29.901334 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:29.901229 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:29.901334 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:29.901315 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:30.901470 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:30.901438 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:30.901885 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:30.901558 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:31.901213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:31.901163 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:31.901412 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:31.901321 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:31.901412 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:31.901378 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:31.901806 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:31.901509 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:32.901643 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:32.901618 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:32.901991 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:32.901721 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:33.615579 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:33.615534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:33.615762 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:33.615589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:33.615762 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.615688 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:33.615762 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.615723 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:33.615928 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.615766 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret podName:eec1a835-7c98-41a2-971f-39390a54adf3 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:49.615745943 +0000 UTC m=+34.219022153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret") pod "global-pull-secret-syncer-cvb5k" (UID: "eec1a835-7c98-41a2-971f-39390a54adf3") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:33.615928 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.615788 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs podName:52ce273b-88d0-4597-9a08-4e59ccf7820d nodeName:}" failed. No retries permitted until 2026-07-13 22:13:49.615778003 +0000 UTC m=+34.219054212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs") pod "network-metrics-daemon-8fp6d" (UID: "52ce273b-88d0-4597-9a08-4e59ccf7820d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:33.716491 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:33.716460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:33.716644 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.716592 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:33.716644 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.716614 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:33.716644 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.716626 2581 projected.go:196] Error preparing data for projected volume kube-api-access-q2l7f for pod openshift-network-diagnostics/network-check-target-vpxg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:33.716790 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.716676 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f podName:b45ee4ea-8111-4745-9e66-4c1034f6f643 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:49.716660241 +0000 UTC m=+34.319936449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2l7f" (UniqueName: "kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f") pod "network-check-target-vpxg5" (UID: "b45ee4ea-8111-4745-9e66-4c1034f6f643") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:33.901533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:33.901449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:33.901533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:33.901464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:33.902023 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.901590 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:33.902023 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:33.901705 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:34.901495 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:34.901461 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:34.901663 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:34.901579 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:35.902535 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:35.902498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:35.902931 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:35.902623 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:35.902931 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:35.902682 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:35.902931 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:35.902802 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:36.901556 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:36.901523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:36.901720 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:36.901646 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:37.901907 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:37.901756 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:37.902499 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:37.901818 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:37.902499 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:37.901984 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:37.902499 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:37.902068 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:38.032139 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.031975 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:13:38.032433 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.032404 2581 generic.go:356] "Generic (PLEG): container finished" podID="d2901cbd-37b2-4230-9412-77025b60a56e" containerID="e62b581fa6f0d3af1aedfd6938847bf9fe1c3334fb4e020355300fc3b571cb49" exitCode=1 Jul 13 22:13:38.032496 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.032476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerStarted","Data":"47c5905ca5dd309197319e175422d3801de6ea70facbd03ae7f75242425ed90f"} Jul 13 22:13:38.032551 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.032539 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerStarted","Data":"38316a3a0bda9f9bb2720a25b9ae28a702ade7234cd053a761a8c79d606a8dda"} Jul 13 22:13:38.032594 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.032581 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerStarted","Data":"43587fa16eee6e964d7afd9e0937f6ffa6570fac592e059ae23fc91830addaaf"} Jul 13 22:13:38.032631 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.032610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerStarted","Data":"fb3fa3fa65af4fdb1ef048479a2cb29be3afd0a53020b33cc0ddf6d2b20976d0"} Jul 13 22:13:38.032684 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.032643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerDied","Data":"e62b581fa6f0d3af1aedfd6938847bf9fe1c3334fb4e020355300fc3b571cb49"} Jul 13 22:13:38.032735 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.032689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerStarted","Data":"960360462c7cb18de83c85ad078ee7e326d00dc76cd8f0bafbada8d2cbdbfdde"} Jul 13 22:13:38.033768 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.033742 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5tw9l" event={"ID":"3d3dfbe4-1786-4e15-aa28-b0854769ddca","Type":"ContainerStarted","Data":"98c219b960bd44305d248e382a9dc4590d8d293fc7fb2af3602d7e9f015b64ea"} Jul 13 22:13:38.035118 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.035096 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" event={"ID":"04dfaae9-20cf-4c61-adb2-9cd582eb1038","Type":"ContainerStarted","Data":"efd5734257fcad62f884bfbe06c8c84d60a1114a793842ab4abe705355afd6a5"} Jul 13 22:13:38.036627 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.036604 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" event={"ID":"02e41b7e-5396-42f9-962e-77b0a2fb6705","Type":"ContainerStarted","Data":"ef7a3d8d1abe5f56f4bf29c90d08dcf0a91568783badb38b135f34c963b45fc0"} Jul 13 22:13:38.037836 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.037817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lnd6b" event={"ID":"2afd7034-1a80-40a3-9ecb-fce5b0e9536a","Type":"ContainerStarted","Data":"40c2a52109fb36f5eae95cfad3ba641ebdc9568de3a3a4ab538a701901a31178"} Jul 13 22:13:38.039327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.039309 2581 generic.go:356] "Generic (PLEG): container finished" podID="a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5" containerID="2bde75b8fc6d36561cdc9199738a6b5874ec383b32d4b70c49dbedb1c291108a" exitCode=0 Jul 13 22:13:38.039431 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.039367 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" event={"ID":"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5","Type":"ContainerDied","Data":"2bde75b8fc6d36561cdc9199738a6b5874ec383b32d4b70c49dbedb1c291108a"} Jul 13 22:13:38.040984 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.040960 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-grfc9" event={"ID":"4f05950a-68e3-4846-af4d-99d2b0eb778d","Type":"ContainerStarted","Data":"49d424f0f55be53ff809a88d1ae989f903f9341530e678f88bd82e2a18988812"} Jul 13 22:13:38.042276 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.042254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9b8w" event={"ID":"5491dbeb-ab6d-4214-80b9-8b1712fe7227","Type":"ContainerStarted","Data":"61b0b76884c5b992a1c276c554514d700a81cc67254e267ebc6c5ea6da74a215"} Jul 13 22:13:38.048950 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.048909 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5tw9l" podStartSLOduration=3.05917943 podStartE2EDuration="22.048897452s" totalImagesPullingTime="18.989718022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:38.048578216 +0000 UTC m=+22.651854444" watchObservedRunningTime="2026-07-13 22:13:38.048897452 +0000 UTC m=+22.652173679" Jul 13 22:13:38.049124 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.049105 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-241.ec2.internal" podStartSLOduration=21.049098582 podStartE2EDuration="21.049098582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:20.009251483 +0000 UTC m=+4.612527714" watchObservedRunningTime="2026-07-13 22:13:38.049098582 +0000 UTC m=+22.652374808" Jul 13 22:13:38.062157 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.062114 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-grfc9" podStartSLOduration=3.074191184 podStartE2EDuration="22.062103235s" totalImagesPullingTime="18.987912051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:38.061965675 +0000 UTC m=+22.665241903" watchObservedRunningTime="2026-07-13 22:13:38.062103235 +0000 UTC m=+22.665379463" Jul 13 22:13:38.100073 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.100035 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k9b8w" podStartSLOduration=3.070316311 podStartE2EDuration="22.100022481s" totalImagesPullingTime="19.02970617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:38.099638979 +0000 UTC m=+22.702915205" watchObservedRunningTime="2026-07-13 22:13:38.100022481 +0000 UTC m=+22.703298705" Jul 13 22:13:38.116895 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.116861 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v4mtl" podStartSLOduration=3.099455374 podStartE2EDuration="22.116849092s" totalImagesPullingTime="19.017393718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:38.116585252 +0000 UTC m=+22.719861510" watchObservedRunningTime="2026-07-13 22:13:38.116849092 +0000 UTC m=+22.720125318" Jul 13 22:13:38.901339 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:38.901309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:38.901675 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:38.901410 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:39.046280 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:39.046246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-flnln" event={"ID":"e6a7daea-2e87-48f1-92ff-c0620625b00b","Type":"ContainerStarted","Data":"77929198b21e24e6e3b051cef104cfeede1683dad18d7f8d8201a61b7f856289"} Jul 13 22:13:39.060323 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:39.060274 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lnd6b" podStartSLOduration=4.072061243 podStartE2EDuration="23.060256013s" totalImagesPullingTime="18.98819477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:38.134965936 +0000 UTC m=+22.738242163" watchObservedRunningTime="2026-07-13 22:13:39.060256013 +0000 UTC m=+23.663532242" Jul 13 22:13:39.060840 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:39.060804 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-flnln" podStartSLOduration=4.072543697 podStartE2EDuration="23.060789749s" totalImagesPullingTime="18.988246052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:39.060108283 +0000 UTC m=+23.663384510" watchObservedRunningTime="2026-07-13 22:13:39.060789749 +0000 UTC m=+23.664065978" Jul 13 22:13:39.093412 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:39.093383 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 22:13:39.833854 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:39.833737 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T22:13:39.093404559Z","UUID":"4876edcf-f0c0-4da3-8412-3d197145db46","Handler":null,"Name":"","Endpoint":""} Jul 13 22:13:39.835507 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:39.835483 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 22:13:39.835650 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:39.835528 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 22:13:39.901928 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:39.901898 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:39.902093 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:39.902045 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:39.902150 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:39.902092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:39.902231 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:39.902203 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:40.050591 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:40.050561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" event={"ID":"02e41b7e-5396-42f9-962e-77b0a2fb6705","Type":"ContainerStarted","Data":"9f0ce047e0e89e4d4e987ce2d17bc4bd1b466297f3f51fd54aec63c8327dda08"} Jul 13 22:13:40.901311 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:40.901129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:40.901516 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:40.901431 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:41.055072 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:41.055033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" event={"ID":"02e41b7e-5396-42f9-962e-77b0a2fb6705","Type":"ContainerStarted","Data":"920a9aa860dfdd71ca68f9a1f236b2cd1294d1703b6385741a7af687b837b060"} Jul 13 22:13:41.058572 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:41.058552 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:13:41.058931 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:41.058909 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerStarted","Data":"431828b81fef849935232815d79801193fd6881d3070521dcfce46d79dbefb12"} Jul 13 22:13:41.072743 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:41.072705 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jnmfc" podStartSLOduration=3.386383203 podStartE2EDuration="25.072692192s" totalImagesPullingTime="21.686308989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:41.072154802 +0000 UTC m=+25.675431021" watchObservedRunningTime="2026-07-13 22:13:41.072692192 +0000 UTC m=+25.675968419" Jul 13 22:13:41.901776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:41.901746 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:41.901959 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:41.901883 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:41.901959 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:41.901916 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:41.902074 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:41.902049 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:42.773641 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:42.773449 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:42.774156 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:42.773916 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:42.776571 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:42.776550 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:42.776868 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:42.776852 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-grfc9" Jul 13 22:13:42.901410 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:42.901382 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:42.901541 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:42.901490 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:43.068086 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:43.068030 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:13:43.068465 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:43.068438 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerStarted","Data":"5e9d26b2074904ac3a106ff4c3a08a6ad0dbe3cc5a2ec81ba26cbeb621b5328e"} Jul 13 22:13:43.068679 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:43.068659 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:43.068852 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:43.068837 2581 scope.go:117] "RemoveContainer" containerID="e62b581fa6f0d3af1aedfd6938847bf9fe1c3334fb4e020355300fc3b571cb49" Jul 13 22:13:43.070344 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:43.070321 2581 generic.go:356] "Generic (PLEG): container finished" podID="a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5" containerID="0971904e182c8a04000d5928b4d8e0e999e773848ba006b9ce782028449ac336" exitCode=0 Jul 13 22:13:43.070455 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:43.070398 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" event={"ID":"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5","Type":"ContainerDied","Data":"0971904e182c8a04000d5928b4d8e0e999e773848ba006b9ce782028449ac336"} Jul 13 22:13:43.084040 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:43.084009 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:43.901601 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:43.901527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:43.901989 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:43.901536 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:43.901989 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:43.901700 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:43.901989 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:43.901735 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:44.076533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.076505 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:13:44.076996 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.076955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" event={"ID":"d2901cbd-37b2-4230-9412-77025b60a56e","Type":"ContainerStarted","Data":"81e3ed1212faee72339014d460596b2f46ef5f46e3fe784e58554976b8d1de6d"} Jul 13 22:13:44.077745 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.077340 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:44.077745 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.077440 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:44.092118 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.092096 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:13:44.174870 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.174781 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" podStartSLOduration=8.9875043 podStartE2EDuration="28.174764512s" totalImagesPullingTime="19.187260212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:44.120476527 +0000 UTC m=+28.723752754" watchObservedRunningTime="2026-07-13 22:13:44.174764512 +0000 UTC m=+28.778040738" Jul 13 22:13:44.764206 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.764173 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cvb5k"] Jul 13 22:13:44.764387 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.764301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:44.764460 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:44.764440 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:44.767275 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.767238 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8fp6d"] Jul 13 22:13:44.767406 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.767332 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:44.767493 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:44.767463 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:44.767818 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.767801 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vpxg5"] Jul 13 22:13:44.767905 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:44.767868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:44.767958 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:44.767943 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:45.080937 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:45.080852 2581 generic.go:356] "Generic (PLEG): container finished" podID="a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5" containerID="0b2f34451de53bc5e042692bd1708d718cc2cd96762e2d37c795e79c2aa55d2c" exitCode=0 Jul 13 22:13:45.081271 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:45.080939 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" event={"ID":"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5","Type":"ContainerDied","Data":"0b2f34451de53bc5e042692bd1708d718cc2cd96762e2d37c795e79c2aa55d2c"} Jul 13 22:13:45.901956 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:45.901803 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:45.902117 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:45.902017 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:46.901592 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:46.901566 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:46.902146 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:46.901565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:46.902146 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:46.901679 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:46.902146 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:46.901729 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:47.090021 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:47.089990 2581 generic.go:356] "Generic (PLEG): container finished" podID="a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5" containerID="f518ab7a6e125d4291a02fcbe1314fd531f392f7177379191642915668e81de8" exitCode=0 Jul 13 22:13:47.090177 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:47.090047 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" event={"ID":"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5","Type":"ContainerDied","Data":"f518ab7a6e125d4291a02fcbe1314fd531f392f7177379191642915668e81de8"} Jul 13 22:13:47.901535 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:47.901507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:47.901716 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:47.901606 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:48.901989 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:48.901914 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:48.902473 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:48.901914 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:48.902473 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:48.902043 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8fp6d" podUID="52ce273b-88d0-4597-9a08-4e59ccf7820d" Jul 13 22:13:48.902473 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:48.902125 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cvb5k" podUID="eec1a835-7c98-41a2-971f-39390a54adf3" Jul 13 22:13:49.634124 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:49.634077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:49.634296 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:49.634140 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:49.634353 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:49.634295 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:49.634404 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:49.634364 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs podName:52ce273b-88d0-4597-9a08-4e59ccf7820d nodeName:}" failed. No retries permitted until 2026-07-13 22:14:21.634342803 +0000 UTC m=+66.237619028 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs") pod "network-metrics-daemon-8fp6d" (UID: "52ce273b-88d0-4597-9a08-4e59ccf7820d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 22:13:49.634895 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:49.634807 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:49.634895 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:49.634870 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret podName:eec1a835-7c98-41a2-971f-39390a54adf3 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:21.634856063 +0000 UTC m=+66.238132268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret") pod "global-pull-secret-syncer-cvb5k" (UID: "eec1a835-7c98-41a2-971f-39390a54adf3") : object "kube-system"/"original-pull-secret" not registered Jul 13 22:13:49.735139 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:49.735103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:49.735296 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:49.735278 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 22:13:49.735364 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:49.735303 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 22:13:49.735364 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:49.735316 2581 projected.go:196] Error preparing data for projected volume kube-api-access-q2l7f for pod openshift-network-diagnostics/network-check-target-vpxg5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:49.735489 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:49.735447 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f podName:b45ee4ea-8111-4745-9e66-4c1034f6f643 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:21.735410978 +0000 UTC m=+66.338687187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q2l7f" (UniqueName: "kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f") pod "network-check-target-vpxg5" (UID: "b45ee4ea-8111-4745-9e66-4c1034f6f643") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 22:13:49.901482 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:49.901393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:49.901637 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:49.901527 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpxg5" podUID="b45ee4ea-8111-4745-9e66-4c1034f6f643" Jul 13 22:13:50.201136 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.201062 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-241.ec2.internal" event="NodeReady" Jul 13 22:13:50.201651 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.201181 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 22:13:50.248184 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.248123 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5957f79d44-8gl4v"] Jul 13 22:13:50.251128 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.251104 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp"] Jul 13 22:13:50.251306 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.251218 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.252736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.252716 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc"] Jul 13 22:13:50.252869 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.252852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp" Jul 13 22:13:50.253494 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.253463 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 13 22:13:50.253717 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.253689 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 13 22:13:50.253831 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.253743 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 13 22:13:50.253902 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.253862 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k2hpl\"" Jul 13 22:13:50.253952 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.253938 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 13 22:13:50.254184 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.254167 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 22:13:50.254435 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.254389 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77fdc59dd4-8pjvz"] Jul 13 22:13:50.254543 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.254479 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:50.254831 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.254725 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 22:13:50.256062 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.256044 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr"] Jul 13 22:13:50.256196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.256175 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.257761 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.257743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:50.258754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.258736 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 13 22:13:50.259705 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.259687 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:13:50.259802 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.259760 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:13:50.259914 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.259895 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xsfhc\"" Jul 13 22:13:50.263795 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.263777 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f"] Jul 13 22:13:50.263996 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.263980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 22:13:50.264217 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.264198 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 22:13:50.265107 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.265086 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 22:13:50.265796 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.265781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:50.267694 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.267667 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 22:13:50.268080 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.268013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zb4qz\"" Jul 13 22:13:50.268254 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.268216 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 22:13:50.268406 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.268373 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 13 22:13:50.268733 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.268713 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dxf4c\"" Jul 13 22:13:50.269545 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.269523 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 22:13:50.271468 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.271412 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"config\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" Jul 13 22:13:50.272056 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.271829 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 13 22:13:50.272145 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.272068 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 13 22:13:50.272145 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.272077 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" Jul 13 22:13:50.273145 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.272549 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 22:13:50.273145 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.272763 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp"] Jul 13 22:13:50.273145 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.272799 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vm4v7\"" Jul 13 22:13:50.273145 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.272901 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 13 22:13:50.273145 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.273075 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-operator-dockercfg-6qmrf\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6qmrf\"" type="*v1.Secret" Jul 13 22:13:50.273439 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.273373 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc"] Jul 13 22:13:50.280449 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.280395 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 22:13:50.284858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.284705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr"] Jul 13 22:13:50.286097 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.286014 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5957f79d44-8gl4v"] Jul 13 22:13:50.286912 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.286889 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77fdc59dd4-8pjvz"] Jul 13 22:13:50.291039 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.291002 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f"] Jul 13 22:13:50.310124 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.310106 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94"] Jul 13 22:13:50.312464 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.312444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.315701 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.314858 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-6qmcp"] Jul 13 22:13:50.315937 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.315917 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 13 22:13:50.316022 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.315997 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 13 22:13:50.316168 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.316148 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:13:50.316259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.316197 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-65c8s\"" Jul 13 22:13:50.316259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.316247 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 13 22:13:50.316958 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.316939 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.317881 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.317861 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j8rtz"] Jul 13 22:13:50.319270 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.319250 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 13 22:13:50.320069 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.320052 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:13:50.321303 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.320412 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 13 22:13:50.321303 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.320413 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr"] Jul 13 22:13:50.321303 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.320506 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.321303 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.320439 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cgdxd\"" Jul 13 22:13:50.321957 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.321937 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 13 22:13:50.323612 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.323576 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6b55c"] Jul 13 22:13:50.323708 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.323680 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr" Jul 13 22:13:50.325838 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.325822 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8xqrn"] Jul 13 22:13:50.325955 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.325934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6b55c" Jul 13 22:13:50.326168 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.326148 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 22:13:50.326508 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.326486 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p77sr\"" Jul 13 22:13:50.326609 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.326488 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 22:13:50.327639 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.327621 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 22:13:50.327731 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.327667 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2567h\"" Jul 13 22:13:50.327816 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.327769 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 22:13:50.327904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.327890 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 22:13:50.328118 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.328098 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jhjjc"] Jul 13 22:13:50.328208 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.328181 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:50.328869 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.328681 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 22:13:50.329224 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.329092 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 13 22:13:50.329471 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.329452 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9d5hg\"" Jul 13 22:13:50.329471 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.329462 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 22:13:50.330259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.330241 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 13 22:13:50.330632 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.330605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.332252 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.332227 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 13 22:13:50.332359 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.332299 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rbmzp\"" Jul 13 22:13:50.335295 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.335279 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 22:13:50.335520 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.335340 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 13 22:13:50.335986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.335966 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 13 22:13:50.337101 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.336493 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hngjg\"" Jul 13 22:13:50.337101 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.336593 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 22:13:50.337236 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.337120 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6b55c"] Jul 13 22:13:50.360937 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.359161 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 13 22:13:50.360937 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.360301 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8rtz"] Jul 13 22:13:50.360937 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.360912 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-6qmcp"] Jul 13 22:13:50.362636 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.362615 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94"] Jul 13 22:13:50.364827 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.364767 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jhjjc"] Jul 13 22:13:50.366020 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.366000 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8xqrn"] Jul 13 22:13:50.387174 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.387153 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr"] Jul 13 22:13:50.438754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.438729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.438884 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.438758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c98ef70-1761-4133-be89-3f213b9af5d6-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-sn86f\" (UID: \"0c98ef70-1761-4133-be89-3f213b9af5d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:50.438884 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.438789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3250ec47-e688-4bfb-9453-83722d21174c-config\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.438884 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.438822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:50.438884 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.438855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f04bca0-c73d-4ac2-971c-37b9596d5d53-tmp\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.438884 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.438881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e25d52-cfe3-40c1-8c4b-45d527aecf2a-cert\") pod \"ingress-canary-6b55c\" (UID: \"90e25d52-cfe3-40c1-8c4b-45d527aecf2a\") " pod="openshift-ingress-canary/ingress-canary-6b55c" Jul 13 22:13:50.439089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.438909 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.439089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.438960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3250ec47-e688-4bfb-9453-83722d21174c-serving-cert\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.439089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.438994 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcm79\" (UniqueName: \"kubernetes.io/projected/3250ec47-e688-4bfb-9453-83722d21174c-kube-api-access-pcm79\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.439089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7-config\") pod \"service-ca-operator-7695fc6c8c-rvb94\" (UID: \"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.439089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh8d5\" (UniqueName: \"kubernetes.io/projected/6a7c1d7c-3a57-4019-9187-2ef2524457cc-kube-api-access-sh8d5\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:50.439089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-installation-pull-secrets\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.439089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439085 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c51dc89-77fb-438b-942b-9dc59ea1b869-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hvd4\" (UniqueName: \"kubernetes.io/projected/0f04bca0-c73d-4ac2-971c-37b9596d5d53-kube-api-access-4hvd4\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f04bca0-c73d-4ac2-971c-37b9596d5d53-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439179 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3250ec47-e688-4bfb-9453-83722d21174c-trusted-ca\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7z68\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-kube-api-access-k7z68\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdbl\" (UniqueName: \"kubernetes.io/projected/265ffc2b-2b91-406a-8533-4584e155db46-kube-api-access-9zdbl\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtpqr\" (UniqueName: \"kubernetes.io/projected/0c51dc89-77fb-438b-942b-9dc59ea1b869-kube-api-access-xtpqr\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439268 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f04bca0-c73d-4ac2-971c-37b9596d5d53-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v68ns\" (UniqueName: \"kubernetes.io/projected/0c98ef70-1761-4133-be89-3f213b9af5d6-kube-api-access-v68ns\") pod \"kube-storage-version-migrator-operator-799cb7f958-sn86f\" (UID: \"0c98ef70-1761-4133-be89-3f213b9af5d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439321 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c98ef70-1761-4133-be89-3f213b9af5d6-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-sn86f\" (UID: \"0c98ef70-1761-4133-be89-3f213b9af5d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cqln\" (UniqueName: \"kubernetes.io/projected/d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7-kube-api-access-8cqln\") pod \"service-ca-operator-7695fc6c8c-rvb94\" (UID: \"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.439373 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-default-certificate\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-registry-certificates\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-image-registry-private-configuration\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0f04bca0-c73d-4ac2-971c-37b9596d5d53-snapshots\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-bound-sa-token\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcr7k\" (UniqueName: \"kubernetes.io/projected/4ef2e39a-c1e8-45aa-8494-b64ddf8faa3a-kube-api-access-qcr7k\") pod \"volume-data-source-validator-78495597f6-gt6zp\" (UID: \"4ef2e39a-c1e8-45aa-8494-b64ddf8faa3a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ee5b6f-56b2-4956-a8de-8634b7830187-config-volume\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439636 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03b29cad-a516-474c-a034-83c7db33f1a8-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-trusted-ca\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmmjb\" (UniqueName: \"kubernetes.io/projected/e89571a5-f1f9-404c-91f9-419fb70afd74-kube-api-access-tmmjb\") pod \"network-check-source-869dcfcdcd-mzbjr\" (UID: \"e89571a5-f1f9-404c-91f9-419fb70afd74\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439697 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1ee5b6f-56b2-4956-a8de-8634b7830187-tmp-dir\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439749 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56sl9\" (UniqueName: \"kubernetes.io/projected/c1ee5b6f-56b2-4956-a8de-8634b7830187-kube-api-access-56sl9\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.439846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-stats-auth\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.440347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7-serving-cert\") pod \"service-ca-operator-7695fc6c8c-rvb94\" (UID: \"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.440347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f04bca0-c73d-4ac2-971c-37b9596d5d53-serving-cert\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.440347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5106856-9233-4bce-b2b3-f53b968de11a-ca-trust-extracted\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.440347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s7g5\" (UniqueName: \"kubernetes.io/projected/90e25d52-cfe3-40c1-8c4b-45d527aecf2a-kube-api-access-8s7g5\") pod \"ingress-canary-6b55c\" (UID: \"90e25d52-cfe3-40c1-8c4b-45d527aecf2a\") " pod="openshift-ingress-canary/ingress-canary-6b55c" Jul 13 22:13:50.440347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.439999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:50.540751 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.540710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c98ef70-1761-4133-be89-3f213b9af5d6-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-sn86f\" (UID: \"0c98ef70-1761-4133-be89-3f213b9af5d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:50.540926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.540782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cqln\" (UniqueName: \"kubernetes.io/projected/d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7-kube-api-access-8cqln\") pod \"service-ca-operator-7695fc6c8c-rvb94\" (UID: \"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.540926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.540802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-default-certificate\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.540926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.540821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.540926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.540844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-registry-certificates\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.540926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.540869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-image-registry-private-configuration\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.540926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.540900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0f04bca0-c73d-4ac2-971c-37b9596d5d53-snapshots\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.541199 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.540956 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 22:13:50.541199 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.540974 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77fdc59dd4-8pjvz: secret "image-registry-tls" not found Jul 13 22:13:50.541199 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.541024 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls podName:c5106856-9233-4bce-b2b3-f53b968de11a nodeName:}" failed. No retries permitted until 2026-07-13 22:13:51.041007509 +0000 UTC m=+35.644283718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls") pod "image-registry-77fdc59dd4-8pjvz" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a") : secret "image-registry-tls" not found Jul 13 22:13:50.541199 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-bound-sa-token\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.541199 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcr7k\" (UniqueName: \"kubernetes.io/projected/4ef2e39a-c1e8-45aa-8494-b64ddf8faa3a-kube-api-access-qcr7k\") pod \"volume-data-source-validator-78495597f6-gt6zp\" (UID: \"4ef2e39a-c1e8-45aa-8494-b64ddf8faa3a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp" Jul 13 22:13:50.541199 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ee5b6f-56b2-4956-a8de-8634b7830187-config-volume\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.541199 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03b29cad-a516-474c-a034-83c7db33f1a8-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:50.541199 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-trusted-ca\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541205 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmjb\" (UniqueName: \"kubernetes.io/projected/e89571a5-f1f9-404c-91f9-419fb70afd74-kube-api-access-tmmjb\") pod \"network-check-source-869dcfcdcd-mzbjr\" (UID: \"e89571a5-f1f9-404c-91f9-419fb70afd74\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541230 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1ee5b6f-56b2-4956-a8de-8634b7830187-tmp-dir\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56sl9\" (UniqueName: \"kubernetes.io/projected/c1ee5b6f-56b2-4956-a8de-8634b7830187-kube-api-access-56sl9\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-stats-auth\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7-serving-cert\") pod \"service-ca-operator-7695fc6c8c-rvb94\" (UID: \"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f04bca0-c73d-4ac2-971c-37b9596d5d53-serving-cert\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5106856-9233-4bce-b2b3-f53b968de11a-ca-trust-extracted\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s7g5\" (UniqueName: \"kubernetes.io/projected/90e25d52-cfe3-40c1-8c4b-45d527aecf2a-kube-api-access-8s7g5\") pod \"ingress-canary-6b55c\" (UID: \"90e25d52-cfe3-40c1-8c4b-45d527aecf2a\") " pod="openshift-ingress-canary/ingress-canary-6b55c" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c98ef70-1761-4133-be89-3f213b9af5d6-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-sn86f\" (UID: \"0c98ef70-1761-4133-be89-3f213b9af5d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3250ec47-e688-4bfb-9453-83722d21174c-config\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-registry-certificates\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:50.541585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541574 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0f04bca0-c73d-4ac2-971c-37b9596d5d53-snapshots\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541599 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f04bca0-c73d-4ac2-971c-37b9596d5d53-tmp\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e25d52-cfe3-40c1-8c4b-45d527aecf2a-cert\") pod \"ingress-canary-6b55c\" (UID: \"90e25d52-cfe3-40c1-8c4b-45d527aecf2a\") " pod="openshift-ingress-canary/ingress-canary-6b55c" Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.541632 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.541690 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls podName:0c51dc89-77fb-438b-942b-9dc59ea1b869 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:51.041673327 +0000 UTC m=+35.644949534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pkzgr" (UID: "0c51dc89-77fb-438b-942b-9dc59ea1b869") : secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541702 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c1ee5b6f-56b2-4956-a8de-8634b7830187-config-volume\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.541725 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.541883 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.541921 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:51.041886695 +0000 UTC m=+35.645162913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : secret "router-metrics-certs-default" not found Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.541942 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls podName:6a7c1d7c-3a57-4019-9187-2ef2524457cc nodeName:}" failed. No retries permitted until 2026-07-13 22:13:51.041932289 +0000 UTC m=+35.645208506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls") pod "cluster-samples-operator-65db858894-w8mrc" (UID: "6a7c1d7c-3a57-4019-9187-2ef2524457cc") : secret "samples-operator-tls" not found Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.541985 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:51.041970122 +0000 UTC m=+35.645246330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : configmap references non-existent config key: service-ca.crt Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.542180 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1ee5b6f-56b2-4956-a8de-8634b7830187-tmp-dir\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.542196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.542196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f04bca0-c73d-4ac2-971c-37b9596d5d53-tmp\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.542846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.542652 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3250ec47-e688-4bfb-9453-83722d21174c-config\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543000 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-trusted-ca\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.541724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3250ec47-e688-4bfb-9453-83722d21174c-serving-cert\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcm79\" (UniqueName: \"kubernetes.io/projected/3250ec47-e688-4bfb-9453-83722d21174c-kube-api-access-pcm79\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543291 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7-config\") pod \"service-ca-operator-7695fc6c8c-rvb94\" (UID: \"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543323 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8d5\" (UniqueName: \"kubernetes.io/projected/6a7c1d7c-3a57-4019-9187-2ef2524457cc-kube-api-access-sh8d5\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-installation-pull-secrets\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c51dc89-77fb-438b-942b-9dc59ea1b869-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hvd4\" (UniqueName: \"kubernetes.io/projected/0f04bca0-c73d-4ac2-971c-37b9596d5d53-kube-api-access-4hvd4\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f04bca0-c73d-4ac2-971c-37b9596d5d53-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3250ec47-e688-4bfb-9453-83722d21174c-trusted-ca\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7z68\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-kube-api-access-k7z68\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdbl\" (UniqueName: \"kubernetes.io/projected/265ffc2b-2b91-406a-8533-4584e155db46-kube-api-access-9zdbl\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtpqr\" (UniqueName: \"kubernetes.io/projected/0c51dc89-77fb-438b-942b-9dc59ea1b869-kube-api-access-xtpqr\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:50.544140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f04bca0-c73d-4ac2-971c-37b9596d5d53-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.544983 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v68ns\" (UniqueName: \"kubernetes.io/projected/0c98ef70-1761-4133-be89-3f213b9af5d6-kube-api-access-v68ns\") pod \"kube-storage-version-migrator-operator-799cb7f958-sn86f\" (UID: \"0c98ef70-1761-4133-be89-3f213b9af5d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:50.544983 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.543831 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/03b29cad-a516-474c-a034-83c7db33f1a8-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:50.544983 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.544725 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7-config\") pod \"service-ca-operator-7695fc6c8c-rvb94\" (UID: \"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.545575 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.545550 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5106856-9233-4bce-b2b3-f53b968de11a-ca-trust-extracted\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.546651 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.545869 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 22:13:50.546651 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.545917 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls podName:c1ee5b6f-56b2-4956-a8de-8634b7830187 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:51.0459038 +0000 UTC m=+35.649180019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls") pod "dns-default-j8rtz" (UID: "c1ee5b6f-56b2-4956-a8de-8634b7830187") : secret "dns-default-metrics-tls" not found Jul 13 22:13:50.546651 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.546275 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3250ec47-e688-4bfb-9453-83722d21174c-trusted-ca\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.546651 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.546443 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 22:13:50.546651 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:50.546590 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert podName:03b29cad-a516-474c-a034-83c7db33f1a8 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:51.046572883 +0000 UTC m=+35.649849089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xqrn" (UID: "03b29cad-a516-474c-a034-83c7db33f1a8") : secret "networking-console-plugin-cert" not found Jul 13 22:13:50.547013 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.546727 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f04bca0-c73d-4ac2-971c-37b9596d5d53-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.547013 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.546963 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c51dc89-77fb-438b-942b-9dc59ea1b869-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:50.547216 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.547193 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7-serving-cert\") pod \"service-ca-operator-7695fc6c8c-rvb94\" (UID: \"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.547372 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.547350 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f04bca0-c73d-4ac2-971c-37b9596d5d53-serving-cert\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.547587 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.547543 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f04bca0-c73d-4ac2-971c-37b9596d5d53-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.547873 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.547739 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-default-certificate\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.548067 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.548045 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3250ec47-e688-4bfb-9453-83722d21174c-serving-cert\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.548514 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.548496 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90e25d52-cfe3-40c1-8c4b-45d527aecf2a-cert\") pod \"ingress-canary-6b55c\" (UID: \"90e25d52-cfe3-40c1-8c4b-45d527aecf2a\") " pod="openshift-ingress-canary/ingress-canary-6b55c" Jul 13 22:13:50.548677 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.548634 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-image-registry-private-configuration\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.549010 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.548990 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-stats-auth\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.549339 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.549323 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-installation-pull-secrets\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.553682 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.553637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmmjb\" (UniqueName: \"kubernetes.io/projected/e89571a5-f1f9-404c-91f9-419fb70afd74-kube-api-access-tmmjb\") pod \"network-check-source-869dcfcdcd-mzbjr\" (UID: \"e89571a5-f1f9-404c-91f9-419fb70afd74\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr" Jul 13 22:13:50.554020 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.553991 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cqln\" (UniqueName: \"kubernetes.io/projected/d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7-kube-api-access-8cqln\") pod \"service-ca-operator-7695fc6c8c-rvb94\" (UID: \"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.554313 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.554258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56sl9\" (UniqueName: \"kubernetes.io/projected/c1ee5b6f-56b2-4956-a8de-8634b7830187-kube-api-access-56sl9\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:50.555128 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.555043 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-bound-sa-token\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.556540 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.556491 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s7g5\" (UniqueName: \"kubernetes.io/projected/90e25d52-cfe3-40c1-8c4b-45d527aecf2a-kube-api-access-8s7g5\") pod \"ingress-canary-6b55c\" (UID: \"90e25d52-cfe3-40c1-8c4b-45d527aecf2a\") " pod="openshift-ingress-canary/ingress-canary-6b55c" Jul 13 22:13:50.556540 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.556493 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcr7k\" (UniqueName: \"kubernetes.io/projected/4ef2e39a-c1e8-45aa-8494-b64ddf8faa3a-kube-api-access-qcr7k\") pod \"volume-data-source-validator-78495597f6-gt6zp\" (UID: \"4ef2e39a-c1e8-45aa-8494-b64ddf8faa3a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp" Jul 13 22:13:50.557504 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.557481 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7z68\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-kube-api-access-k7z68\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:50.557894 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.557844 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdbl\" (UniqueName: \"kubernetes.io/projected/265ffc2b-2b91-406a-8533-4584e155db46-kube-api-access-9zdbl\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:50.557990 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.557906 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh8d5\" (UniqueName: \"kubernetes.io/projected/6a7c1d7c-3a57-4019-9187-2ef2524457cc-kube-api-access-sh8d5\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:50.558881 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.558813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:13:50.558881 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.558845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtpqr\" (UniqueName: \"kubernetes.io/projected/0c51dc89-77fb-438b-942b-9dc59ea1b869-kube-api-access-xtpqr\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:50.559106 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.559072 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hvd4\" (UniqueName: \"kubernetes.io/projected/0f04bca0-c73d-4ac2-971c-37b9596d5d53-kube-api-access-4hvd4\") pod \"insights-operator-68d9dd94cf-jhjjc\" (UID: \"0f04bca0-c73d-4ac2-971c-37b9596d5d53\") " pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.560108 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.560086 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcm79\" (UniqueName: \"kubernetes.io/projected/3250ec47-e688-4bfb-9453-83722d21174c-kube-api-access-pcm79\") pod \"console-operator-7866497494-6qmcp\" (UID: \"3250ec47-e688-4bfb-9453-83722d21174c\") " pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.585834 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.585814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp" Jul 13 22:13:50.624989 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.624970 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" Jul 13 22:13:50.632664 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.632506 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:13:50.647396 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.647374 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr" Jul 13 22:13:50.656070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.656052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6b55c" Jul 13 22:13:50.668023 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.668001 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:13:50.670869 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.670850 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" Jul 13 22:13:50.901743 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.901664 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:13:50.901743 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.901695 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:13:50.906636 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.906616 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 22:13:50.907126 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.907095 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 22:13:50.907225 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:50.907193 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jtd57\"" Jul 13 22:13:51.047262 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.047225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:51.047449 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.047277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:51.047449 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.047327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:51.047449 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047342 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 22:13:51.047449 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047408 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert podName:03b29cad-a516-474c-a034-83c7db33f1a8 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.047392507 +0000 UTC m=+36.650668717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xqrn" (UID: "03b29cad-a516-474c-a034-83c7db33f1a8") : secret "networking-console-plugin-cert" not found Jul 13 22:13:51.047449 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047437 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.047472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047495 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls podName:c1ee5b6f-56b2-4956-a8de-8634b7830187 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.047478595 +0000 UTC m=+36.650754814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls") pod "dns-default-j8rtz" (UID: "c1ee5b6f-56b2-4956-a8de-8634b7830187") : secret "dns-default-metrics-tls" not found Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.047534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047544 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047561 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77fdc59dd4-8pjvz: secret "image-registry-tls" not found Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.047568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047609 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls podName:c5106856-9233-4bce-b2b3-f53b968de11a nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.047593565 +0000 UTC m=+36.650869787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls") pod "image-registry-77fdc59dd4-8pjvz" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a") : secret "image-registry-tls" not found Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047651 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.047653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047690 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls podName:0c51dc89-77fb-438b-942b-9dc59ea1b869 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.04767558 +0000 UTC m=+36.650951790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pkzgr" (UID: "0c51dc89-77fb-438b-942b-9dc59ea1b869") : secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:51.047717 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047690 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 22:13:51.048089 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047762 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls podName:6a7c1d7c-3a57-4019-9187-2ef2524457cc nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.047745507 +0000 UTC m=+36.651021729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls") pod "cluster-samples-operator-65db858894-w8mrc" (UID: "6a7c1d7c-3a57-4019-9187-2ef2524457cc") : secret "samples-operator-tls" not found Jul 13 22:13:51.048089 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047761 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 22:13:51.048089 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047781 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.047771922 +0000 UTC m=+36.651048127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : configmap references non-existent config key: service-ca.crt Jul 13 22:13:51.048089 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:51.047803 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:52.047794342 +0000 UTC m=+36.651070547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : secret "router-metrics-certs-default" not found Jul 13 22:13:51.195664 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.195559 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 13 22:13:51.202204 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.202179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c98ef70-1761-4133-be89-3f213b9af5d6-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-sn86f\" (UID: \"0c98ef70-1761-4133-be89-3f213b9af5d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:51.209694 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.209673 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:13:51.248471 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.248448 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 13 22:13:51.256882 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.256860 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v68ns\" (UniqueName: \"kubernetes.io/projected/0c98ef70-1761-4133-be89-3f213b9af5d6-kube-api-access-v68ns\") pod \"kube-storage-version-migrator-operator-799cb7f958-sn86f\" (UID: \"0c98ef70-1761-4133-be89-3f213b9af5d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:51.520861 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.520805 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 13 22:13:51.526867 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.526797 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c98ef70-1761-4133-be89-3f213b9af5d6-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-sn86f\" (UID: \"0c98ef70-1761-4133-be89-3f213b9af5d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:51.573382 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.572199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6qmrf\"" Jul 13 22:13:51.696887 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.695802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:13:51.737134 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.737086 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-6qmcp"] Jul 13 22:13:51.739742 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.739722 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6b55c"] Jul 13 22:13:51.743708 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.743653 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jhjjc"] Jul 13 22:13:51.754113 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.754088 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp"] Jul 13 22:13:51.760077 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.760044 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr"] Jul 13 22:13:51.769399 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.769376 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94"] Jul 13 22:13:51.773056 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:51.773027 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89571a5_f1f9_404c_91f9_419fb70afd74.slice/crio-5c20b99eeb8d9bf2345343ff48743a78d7b22a87e7311f914a2bb14682a6c9ef WatchSource:0}: Error finding container 5c20b99eeb8d9bf2345343ff48743a78d7b22a87e7311f914a2bb14682a6c9ef: Status 404 returned error can't find the container with id 5c20b99eeb8d9bf2345343ff48743a78d7b22a87e7311f914a2bb14682a6c9ef Jul 13 22:13:51.775250 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:51.775153 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef2e39a_c1e8_45aa_8494_b64ddf8faa3a.slice/crio-b87bf1ccb8555d8c654c0393137de6b91ace4aff360d9c335300c8061642bc38 WatchSource:0}: Error finding container b87bf1ccb8555d8c654c0393137de6b91ace4aff360d9c335300c8061642bc38: Status 404 returned error can't find the container with id b87bf1ccb8555d8c654c0393137de6b91ace4aff360d9c335300c8061642bc38 Jul 13 22:13:51.779919 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:51.779897 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3250ec47_e688_4bfb_9453_83722d21174c.slice/crio-b871b8aa4067af3541b4d8fd3a1383b6b399a5835571a72f8d6e90ee19e54307 WatchSource:0}: Error finding container b871b8aa4067af3541b4d8fd3a1383b6b399a5835571a72f8d6e90ee19e54307: Status 404 returned error can't find the container with id b871b8aa4067af3541b4d8fd3a1383b6b399a5835571a72f8d6e90ee19e54307 Jul 13 22:13:51.781663 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:51.781641 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90e25d52_cfe3_40c1_8c4b_45d527aecf2a.slice/crio-042df5a14071f5a5adef32bf0d3c7a06428c3de45602161294bccfc585a37773 WatchSource:0}: Error finding container 042df5a14071f5a5adef32bf0d3c7a06428c3de45602161294bccfc585a37773: Status 404 returned error can't find the container with id 042df5a14071f5a5adef32bf0d3c7a06428c3de45602161294bccfc585a37773 Jul 13 22:13:51.806233 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.806213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" Jul 13 22:13:51.901950 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.901800 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:13:51.904530 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.904505 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpxwn\"" Jul 13 22:13:51.950237 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:51.950215 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f"] Jul 13 22:13:51.953393 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:13:51.953372 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c98ef70_1761_4133_be89_3f213b9af5d6.slice/crio-f32a99be743b294238d4cc1b33b00fe6b665f7db7f012edc9308c02db32c0460 WatchSource:0}: Error finding container f32a99be743b294238d4cc1b33b00fe6b665f7db7f012edc9308c02db32c0460: Status 404 returned error can't find the container with id f32a99be743b294238d4cc1b33b00fe6b665f7db7f012edc9308c02db32c0460 Jul 13 22:13:52.058823 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.058797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:52.058919 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.058834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:52.058919 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.058865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:52.059046 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.058937 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 22:13:52.059046 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.058961 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:52.059046 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.058972 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:54.058950747 +0000 UTC m=+38.662226956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : configmap references non-existent config key: service-ca.crt Jul 13 22:13:52.059046 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.058996 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:52.059046 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059008 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls podName:0c51dc89-77fb-438b-942b-9dc59ea1b869 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:54.058992667 +0000 UTC m=+38.662268873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pkzgr" (UID: "0c51dc89-77fb-438b-942b-9dc59ea1b869") : secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:52.059046 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059032 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls podName:6a7c1d7c-3a57-4019-9187-2ef2524457cc nodeName:}" failed. No retries permitted until 2026-07-13 22:13:54.059020178 +0000 UTC m=+38.662296388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls") pod "cluster-samples-operator-65db858894-w8mrc" (UID: "6a7c1d7c-3a57-4019-9187-2ef2524457cc") : secret "samples-operator-tls" not found Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059050 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059075 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:54.059067035 +0000 UTC m=+38.662343239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : secret "router-metrics-certs-default" not found Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.059105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.059138 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.059180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059197 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059235 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert podName:03b29cad-a516-474c-a034-83c7db33f1a8 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:54.05922409 +0000 UTC m=+38.662500314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xqrn" (UID: "03b29cad-a516-474c-a034-83c7db33f1a8") : secret "networking-console-plugin-cert" not found Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059271 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059276 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059285 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77fdc59dd4-8pjvz: secret "image-registry-tls" not found Jul 13 22:13:52.059306 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059305 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls podName:c1ee5b6f-56b2-4956-a8de-8634b7830187 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:54.059293116 +0000 UTC m=+38.662569320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls") pod "dns-default-j8rtz" (UID: "c1ee5b6f-56b2-4956-a8de-8634b7830187") : secret "dns-default-metrics-tls" not found Jul 13 22:13:52.059677 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:52.059317 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls podName:c5106856-9233-4bce-b2b3-f53b968de11a nodeName:}" failed. No retries permitted until 2026-07-13 22:13:54.059311677 +0000 UTC m=+38.662587881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls") pod "image-registry-77fdc59dd4-8pjvz" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a") : secret "image-registry-tls" not found Jul 13 22:13:52.101554 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.101527 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6b55c" event={"ID":"90e25d52-cfe3-40c1-8c4b-45d527aecf2a","Type":"ContainerStarted","Data":"042df5a14071f5a5adef32bf0d3c7a06428c3de45602161294bccfc585a37773"} Jul 13 22:13:52.102607 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.102580 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" event={"ID":"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7","Type":"ContainerStarted","Data":"4af8c030ea16aa7ceba42188913afb81ff0f6bec05921760747a9c1d6355cff2"} Jul 13 22:13:52.103624 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.103605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp" event={"ID":"4ef2e39a-c1e8-45aa-8494-b64ddf8faa3a","Type":"ContainerStarted","Data":"b87bf1ccb8555d8c654c0393137de6b91ace4aff360d9c335300c8061642bc38"} Jul 13 22:13:52.106290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.106271 2581 generic.go:356] "Generic (PLEG): container finished" podID="a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5" containerID="2a4ac525e1d8abe0262457c362592d8eff5f8b9ddfea4f4ecd229b10509b2aa3" exitCode=0 Jul 13 22:13:52.106371 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.106331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" event={"ID":"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5","Type":"ContainerDied","Data":"2a4ac525e1d8abe0262457c362592d8eff5f8b9ddfea4f4ecd229b10509b2aa3"} Jul 13 22:13:52.107401 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.107378 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" event={"ID":"0c98ef70-1761-4133-be89-3f213b9af5d6","Type":"ContainerStarted","Data":"f32a99be743b294238d4cc1b33b00fe6b665f7db7f012edc9308c02db32c0460"} Jul 13 22:13:52.108514 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.108492 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr" event={"ID":"e89571a5-f1f9-404c-91f9-419fb70afd74","Type":"ContainerStarted","Data":"5c20b99eeb8d9bf2345343ff48743a78d7b22a87e7311f914a2bb14682a6c9ef"} Jul 13 22:13:52.109557 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.109540 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" event={"ID":"0f04bca0-c73d-4ac2-971c-37b9596d5d53","Type":"ContainerStarted","Data":"5f95771a3c171b3b9f18565fe5baa4401c655ee504b790be4e024b3fa2d55c0d"} Jul 13 22:13:52.110667 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:52.110646 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6qmcp" event={"ID":"3250ec47-e688-4bfb-9453-83722d21174c","Type":"ContainerStarted","Data":"b871b8aa4067af3541b4d8fd3a1383b6b399a5835571a72f8d6e90ee19e54307"} Jul 13 22:13:53.123533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:53.122466 2581 generic.go:356] "Generic (PLEG): container finished" podID="a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5" containerID="ead8c0e061fdf64d7468f3ae8dd403f5dd292aa8f0da931bcbc0267082bd7357" exitCode=0 Jul 13 22:13:53.123533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:53.122553 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" event={"ID":"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5","Type":"ContainerDied","Data":"ead8c0e061fdf64d7468f3ae8dd403f5dd292aa8f0da931bcbc0267082bd7357"} Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.079231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.079286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.079344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.079413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.079459 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.079514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.079550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.079685 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.079744 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:58.07972578 +0000 UTC m=+42.683001991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : secret "router-metrics-certs-default" not found Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080137 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080185 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert podName:03b29cad-a516-474c-a034-83c7db33f1a8 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:58.080169758 +0000 UTC m=+42.683445980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xqrn" (UID: "03b29cad-a516-474c-a034-83c7db33f1a8") : secret "networking-console-plugin-cert" not found Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080244 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080274 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls podName:c1ee5b6f-56b2-4956-a8de-8634b7830187 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:58.080263505 +0000 UTC m=+42.683539714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls") pod "dns-default-j8rtz" (UID: "c1ee5b6f-56b2-4956-a8de-8634b7830187") : secret "dns-default-metrics-tls" not found Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080338 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080350 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77fdc59dd4-8pjvz: secret "image-registry-tls" not found Jul 13 22:13:54.080680 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080382 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls podName:c5106856-9233-4bce-b2b3-f53b968de11a nodeName:}" failed. No retries permitted until 2026-07-13 22:13:58.080371333 +0000 UTC m=+42.683647538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls") pod "image-registry-77fdc59dd4-8pjvz" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a") : secret "image-registry-tls" not found Jul 13 22:13:54.081602 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080455 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 22:13:54.081602 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080487 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls podName:6a7c1d7c-3a57-4019-9187-2ef2524457cc nodeName:}" failed. No retries permitted until 2026-07-13 22:13:58.080476655 +0000 UTC m=+42.683752865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls") pod "cluster-samples-operator-65db858894-w8mrc" (UID: "6a7c1d7c-3a57-4019-9187-2ef2524457cc") : secret "samples-operator-tls" not found Jul 13 22:13:54.081602 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080554 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:58.080544323 +0000 UTC m=+42.683820531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : configmap references non-existent config key: service-ca.crt Jul 13 22:13:54.081602 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080611 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:54.081602 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:54.080642 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls podName:0c51dc89-77fb-438b-942b-9dc59ea1b869 nodeName:}" failed. No retries permitted until 2026-07-13 22:13:58.080631626 +0000 UTC m=+42.683907835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pkzgr" (UID: "0c51dc89-77fb-438b-942b-9dc59ea1b869") : secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:54.135803 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.134903 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" event={"ID":"a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5","Type":"ContainerStarted","Data":"dc8ede1281973852654884ac7c3dab5cb68ffa6d0d96c3d2cf6f5e16747229b7"} Jul 13 22:13:54.161675 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.160483 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kgmrv" podStartSLOduration=7.627985114 podStartE2EDuration="38.160463532s" totalImagesPullingTime="30.532478418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:13:54.15837093 +0000 UTC m=+38.761647206" watchObservedRunningTime="2026-07-13 22:13:54.160463532 +0000 UTC m=+38.763739759" Jul 13 22:13:54.282938 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.282888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:13:54.347150 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:54.347068 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:13:56.290521 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:56.290238 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:13:58.116284 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:58.116250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:58.116310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:58.116340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:58.116368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:58.116399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116451 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116457 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116481 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77fdc59dd4-8pjvz: secret "image-registry-tls" not found Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:58.116465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116517 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls podName:6a7c1d7c-3a57-4019-9187-2ef2524457cc nodeName:}" failed. No retries permitted until 2026-07-13 22:14:06.116497043 +0000 UTC m=+50.719773268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls") pod "cluster-samples-operator-65db858894-w8mrc" (UID: "6a7c1d7c-3a57-4019-9187-2ef2524457cc") : secret "samples-operator-tls" not found Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116520 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116527 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116541 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls podName:c5106856-9233-4bce-b2b3-f53b968de11a nodeName:}" failed. No retries permitted until 2026-07-13 22:14:06.116530755 +0000 UTC m=+50.719806963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls") pod "image-registry-77fdc59dd4-8pjvz" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a") : secret "image-registry-tls" not found Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116556 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert podName:03b29cad-a516-474c-a034-83c7db33f1a8 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:06.11654865 +0000 UTC m=+50.719824854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xqrn" (UID: "03b29cad-a516-474c-a034-83c7db33f1a8") : secret "networking-console-plugin-cert" not found Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116555 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 22:13:58.116738 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116586 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls podName:0c51dc89-77fb-438b-942b-9dc59ea1b869 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:06.116568013 +0000 UTC m=+50.719844218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pkzgr" (UID: "0c51dc89-77fb-438b-942b-9dc59ea1b869") : secret "cluster-monitoring-operator-tls" not found Jul 13 22:13:58.117261 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116603 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:06.116596872 +0000 UTC m=+50.719873076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : secret "router-metrics-certs-default" not found Jul 13 22:13:58.117261 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116615 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:06.116609961 +0000 UTC m=+50.719886166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : configmap references non-existent config key: service-ca.crt Jul 13 22:13:58.117261 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:58.116644 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:13:58.117261 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116725 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 22:13:58.117261 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:13:58.116756 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls podName:c1ee5b6f-56b2-4956-a8de-8634b7830187 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:06.116745827 +0000 UTC m=+50.720022035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls") pod "dns-default-j8rtz" (UID: "c1ee5b6f-56b2-4956-a8de-8634b7830187") : secret "dns-default-metrics-tls" not found Jul 13 22:13:59.860246 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:59.860212 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:13:59.919017 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:13:59.918942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:00.152749 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.152676 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/0.log" Jul 13 22:14:00.152749 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.152716 2581 generic.go:356] "Generic (PLEG): container finished" podID="3250ec47-e688-4bfb-9453-83722d21174c" containerID="d65139b51fc67bc886958f00d7cb628f92b5cf1a708a0ec3930b37f832ede1fa" exitCode=255 Jul 13 22:14:00.152956 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.152799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6qmcp" event={"ID":"3250ec47-e688-4bfb-9453-83722d21174c","Type":"ContainerDied","Data":"d65139b51fc67bc886958f00d7cb628f92b5cf1a708a0ec3930b37f832ede1fa"} Jul 13 22:14:00.153259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.153114 2581 scope.go:117] "RemoveContainer" containerID="d65139b51fc67bc886958f00d7cb628f92b5cf1a708a0ec3930b37f832ede1fa" Jul 13 22:14:00.155619 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.155073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6b55c" event={"ID":"90e25d52-cfe3-40c1-8c4b-45d527aecf2a","Type":"ContainerStarted","Data":"1fe471b7fe0eb10c1b84eb5c57066f3d6a45ca590be4fcb39f958924a9ac0915"} Jul 13 22:14:00.158087 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.158056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" event={"ID":"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7","Type":"ContainerStarted","Data":"a226c0e033afca3d565613ef96a5e8bd19e008fc0822acc54ac446dd238e0209"} Jul 13 22:14:00.160195 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.160154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp" event={"ID":"4ef2e39a-c1e8-45aa-8494-b64ddf8faa3a","Type":"ContainerStarted","Data":"a358c952a951dbd24cc749e81fc9b4a4c6ddf1b09c085f3fee37ca615dc24c9b"} Jul 13 22:14:00.161665 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.161645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" event={"ID":"0c98ef70-1761-4133-be89-3f213b9af5d6","Type":"ContainerStarted","Data":"4a76c47db6991fc50dbc0f152fb9aa7a2c3af9b111166671a87ca307aa42715a"} Jul 13 22:14:00.163342 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.163303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr" event={"ID":"e89571a5-f1f9-404c-91f9-419fb70afd74","Type":"ContainerStarted","Data":"ed1c7a1993b7c5b56ca815f74bce7b19200bd0cf178de42ce916ea69b6e5dc9c"} Jul 13 22:14:00.164815 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.164779 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" event={"ID":"0f04bca0-c73d-4ac2-971c-37b9596d5d53","Type":"ContainerStarted","Data":"00a480fbd8b8d9a61fe00fa21446b77f2c2124466ef7309487d278e9e2518d33"} Jul 13 22:14:00.191767 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.191593 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-gt6zp" podStartSLOduration=8.82328779 podStartE2EDuration="16.191578146s" totalImagesPullingTime="7.368290356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:00.191276937 +0000 UTC m=+44.794553164" watchObservedRunningTime="2026-07-13 22:14:00.191578146 +0000 UTC m=+44.794854373" Jul 13 22:14:00.207828 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.207401 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" podStartSLOduration=8.795591238 podStartE2EDuration="16.207388485s" totalImagesPullingTime="7.411797247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:00.20711398 +0000 UTC m=+44.810390210" watchObservedRunningTime="2026-07-13 22:14:00.207388485 +0000 UTC m=+44.810664711" Jul 13 22:14:00.234808 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.234758 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" podStartSLOduration=8.999468436 podStartE2EDuration="16.234740176s" totalImagesPullingTime="7.23527174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:00.232650169 +0000 UTC m=+44.835926397" watchObservedRunningTime="2026-07-13 22:14:00.234740176 +0000 UTC m=+44.838016405" Jul 13 22:14:00.258527 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.258413 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-mzbjr" podStartSLOduration=8.832823563 podStartE2EDuration="16.258395892s" totalImagesPullingTime="7.425572329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:00.258198604 +0000 UTC m=+44.861474833" watchObservedRunningTime="2026-07-13 22:14:00.258395892 +0000 UTC m=+44.861672121" Jul 13 22:14:00.280386 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.280176 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" podStartSLOduration=8.866535441 podStartE2EDuration="16.280151183s" totalImagesPullingTime="7.413615742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:00.279714093 +0000 UTC m=+44.882990325" watchObservedRunningTime="2026-07-13 22:14:00.280151183 +0000 UTC m=+44.883427392" Jul 13 22:14:00.283465 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.283406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:00.299049 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.298905 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6b55c" podStartSLOduration=2.601191769 podStartE2EDuration="10.298888936s" totalImagesPullingTime="7.697697167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:00.29714991 +0000 UTC m=+44.900426142" watchObservedRunningTime="2026-07-13 22:14:00.298888936 +0000 UTC m=+44.902165162" Jul 13 22:14:00.371010 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.370956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:00.633350 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.633309 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:14:00.633534 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.633399 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:14:00.946855 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:00.946773 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:01.051646 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.051610 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:01.156739 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.156695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:01.170264 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.170239 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:14:01.170700 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.170681 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/0.log" Jul 13 22:14:01.170781 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.170724 2581 generic.go:356] "Generic (PLEG): container finished" podID="3250ec47-e688-4bfb-9453-83722d21174c" containerID="2d0319691c2bd3357ce7b72906dcb4b4ed8cba6219d1a9461e21184b6054559f" exitCode=255 Jul 13 22:14:01.170835 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.170810 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6qmcp" event={"ID":"3250ec47-e688-4bfb-9453-83722d21174c","Type":"ContainerDied","Data":"2d0319691c2bd3357ce7b72906dcb4b4ed8cba6219d1a9461e21184b6054559f"} Jul 13 22:14:01.170889 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.170870 2581 scope.go:117] "RemoveContainer" containerID="d65139b51fc67bc886958f00d7cb628f92b5cf1a708a0ec3930b37f832ede1fa" Jul 13 22:14:01.171112 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.171097 2581 scope.go:117] "RemoveContainer" containerID="2d0319691c2bd3357ce7b72906dcb4b4ed8cba6219d1a9461e21184b6054559f" Jul 13 22:14:01.171367 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:01.171342 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6qmcp_openshift-console-operator(3250ec47-e688-4bfb-9453-83722d21174c)\"" pod="openshift-console-operator/console-operator-7866497494-6qmcp" podUID="3250ec47-e688-4bfb-9453-83722d21174c" Jul 13 22:14:01.257953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.257908 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:01.309595 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.309563 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fqvxz"] Jul 13 22:14:01.338516 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.338489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fqvxz"] Jul 13 22:14:01.338652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.338626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.341437 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.341396 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w5vtc\"" Jul 13 22:14:01.341648 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.341633 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 22:14:01.341740 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.341644 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 22:14:01.446807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.446779 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.446926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.446811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.446926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.446831 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5610c01c-4319-45be-9c57-de3d60626fb6-crio-socket\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.446996 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.446939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86q6f\" (UniqueName: \"kubernetes.io/projected/5610c01c-4319-45be-9c57-de3d60626fb6-kube-api-access-86q6f\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.446996 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.446973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5610c01c-4319-45be-9c57-de3d60626fb6-data-volume\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.459520 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.459449 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:01.547865 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.547833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.548003 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.547874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.548003 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.547901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5610c01c-4319-45be-9c57-de3d60626fb6-crio-socket\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.548003 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:01.547961 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 22:14:01.548003 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.547976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86q6f\" (UniqueName: \"kubernetes.io/projected/5610c01c-4319-45be-9c57-de3d60626fb6-kube-api-access-86q6f\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.548003 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:01.547986 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 22:14:01.548249 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.548013 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5610c01c-4319-45be-9c57-de3d60626fb6-data-volume\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.548249 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:01.548033 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm podName:5610c01c-4319-45be-9c57-de3d60626fb6 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:02.048012029 +0000 UTC m=+46.651288276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqvxz" (UID: "5610c01c-4319-45be-9c57-de3d60626fb6") : configmap "kube-rbac-proxy" not found Jul 13 22:14:01.548249 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:01.548053 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls podName:5610c01c-4319-45be-9c57-de3d60626fb6 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:02.048042483 +0000 UTC m=+46.651318694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqvxz" (UID: "5610c01c-4319-45be-9c57-de3d60626fb6") : secret "insights-runtime-extractor-tls" not found Jul 13 22:14:01.548249 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.548125 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5610c01c-4319-45be-9c57-de3d60626fb6-crio-socket\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.548464 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.548337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5610c01c-4319-45be-9c57-de3d60626fb6-data-volume\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.557964 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.557941 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86q6f\" (UniqueName: \"kubernetes.io/projected/5610c01c-4319-45be-9c57-de3d60626fb6-kube-api-access-86q6f\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:01.913497 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.913464 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:01.987493 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:01.987467 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:02.052697 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:02.052666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:02.052846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:02.052709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:02.052846 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:02.052782 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 22:14:02.052846 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:02.052808 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 22:14:02.053000 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:02.052879 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls podName:5610c01c-4319-45be-9c57-de3d60626fb6 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:03.052859272 +0000 UTC m=+47.656135477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqvxz" (UID: "5610c01c-4319-45be-9c57-de3d60626fb6") : secret "insights-runtime-extractor-tls" not found Jul 13 22:14:02.053000 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:02.052900 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm podName:5610c01c-4319-45be-9c57-de3d60626fb6 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:03.052893094 +0000 UTC m=+47.656169299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqvxz" (UID: "5610c01c-4319-45be-9c57-de3d60626fb6") : configmap "kube-rbac-proxy" not found Jul 13 22:14:02.175478 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:02.175389 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:14:02.175763 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:02.175746 2581 scope.go:117] "RemoveContainer" containerID="2d0319691c2bd3357ce7b72906dcb4b4ed8cba6219d1a9461e21184b6054559f" Jul 13 22:14:02.175930 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:02.175910 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6qmcp_openshift-console-operator(3250ec47-e688-4bfb-9453-83722d21174c)\"" pod="openshift-console-operator/console-operator-7866497494-6qmcp" podUID="3250ec47-e688-4bfb-9453-83722d21174c" Jul 13 22:14:03.062130 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:03.062097 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:03.062130 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:03.062130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:03.062547 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:03.062252 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 22:14:03.062547 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:03.062255 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 22:14:03.062547 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:03.062304 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm podName:5610c01c-4319-45be-9c57-de3d60626fb6 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:05.062290358 +0000 UTC m=+49.665566564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqvxz" (UID: "5610c01c-4319-45be-9c57-de3d60626fb6") : configmap "kube-rbac-proxy" not found Jul 13 22:14:03.062547 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:03.062316 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls podName:5610c01c-4319-45be-9c57-de3d60626fb6 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:05.062310697 +0000 UTC m=+49.665586902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqvxz" (UID: "5610c01c-4319-45be-9c57-de3d60626fb6") : secret "insights-runtime-extractor-tls" not found Jul 13 22:14:03.366256 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:03.366179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:03.460857 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:03.460823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:03.508191 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:03.508165 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5tw9l_3d3dfbe4-1786-4e15-aa28-b0854769ddca/dns-node-resolver/0.log" Jul 13 22:14:04.324920 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:04.324892 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:04.708076 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:04.708007 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lnd6b_2afd7034-1a80-40a3-9ecb-fce5b0e9536a/node-ca/0.log" Jul 13 22:14:05.080167 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:05.080135 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:05.080307 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:05.080173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:05.080307 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:05.080278 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 22:14:05.080307 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:05.080281 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 22:14:05.080473 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:05.080330 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm podName:5610c01c-4319-45be-9c57-de3d60626fb6 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:09.080316233 +0000 UTC m=+53.683592438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fqvxz" (UID: "5610c01c-4319-45be-9c57-de3d60626fb6") : configmap "kube-rbac-proxy" not found Jul 13 22:14:05.080473 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:05.080343 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls podName:5610c01c-4319-45be-9c57-de3d60626fb6 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:09.080337003 +0000 UTC m=+53.683613209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqvxz" (UID: "5610c01c-4319-45be-9c57-de3d60626fb6") : secret "insights-runtime-extractor-tls" not found Jul 13 22:14:05.199865 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:05.199833 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:05.301838 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:05.301806 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:05.308117 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:05.308095 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6b55c_90e25d52-cfe3-40c1-8c4b-45d527aecf2a/serve-healthcheck-canary/0.log" Jul 13 22:14:06.115261 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:06.115228 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-sn86f_0c98ef70-1761-4133-be89-3f213b9af5d6/kube-storage-version-migrator-operator/0.log" Jul 13 22:14:06.188642 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:06.188615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:14:06.188642 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:06.188648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:06.188670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:06.188706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:06.188759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188765 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:06.188810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188818 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188847 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188855 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls podName:6a7c1d7c-3a57-4019-9187-2ef2524457cc nodeName:}" failed. No retries permitted until 2026-07-13 22:14:22.188816549 +0000 UTC m=+66.792092768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls") pod "cluster-samples-operator-65db858894-w8mrc" (UID: "6a7c1d7c-3a57-4019-9187-2ef2524457cc") : secret "samples-operator-tls" not found Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188875 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188895 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:22.188877215 +0000 UTC m=+66.792153426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : configmap references non-existent config key: service-ca.crt Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188898 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 22:14:06.188916 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188924 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls podName:0c51dc89-77fb-438b-942b-9dc59ea1b869 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:22.188912887 +0000 UTC m=+66.792189097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pkzgr" (UID: "0c51dc89-77fb-438b-942b-9dc59ea1b869") : secret "cluster-monitoring-operator-tls" not found Jul 13 22:14:06.189334 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188952 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs podName:265ffc2b-2b91-406a-8533-4584e155db46 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:22.18894243 +0000 UTC m=+66.792218636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs") pod "router-default-5957f79d44-8gl4v" (UID: "265ffc2b-2b91-406a-8533-4584e155db46") : secret "router-metrics-certs-default" not found Jul 13 22:14:06.189334 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188985 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls podName:c1ee5b6f-56b2-4956-a8de-8634b7830187 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:22.188976416 +0000 UTC m=+66.792252636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls") pod "dns-default-j8rtz" (UID: "c1ee5b6f-56b2-4956-a8de-8634b7830187") : secret "dns-default-metrics-tls" not found Jul 13 22:14:06.189334 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.188996 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert podName:03b29cad-a516-474c-a034-83c7db33f1a8 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:22.188991542 +0000 UTC m=+66.792267747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8xqrn" (UID: "03b29cad-a516-474c-a034-83c7db33f1a8") : secret "networking-console-plugin-cert" not found Jul 13 22:14:06.189334 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:06.189041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:14:06.189334 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.189167 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 22:14:06.189334 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.189178 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77fdc59dd4-8pjvz: secret "image-registry-tls" not found Jul 13 22:14:06.189334 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:06.189226 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls podName:c5106856-9233-4bce-b2b3-f53b968de11a nodeName:}" failed. No retries permitted until 2026-07-13 22:14:22.189215888 +0000 UTC m=+66.792492093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls") pod "image-registry-77fdc59dd4-8pjvz" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a") : secret "image-registry-tls" not found Jul 13 22:14:06.777848 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:06.777815 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:07.344706 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:07.344675 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:07.737786 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:07.737704 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:07.969503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:07.969472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:08.129671 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:08.129622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:08.232479 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:08.232443 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:08.334384 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:08.334351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:08.508225 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:08.508193 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:08.608823 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:08.608794 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:09.022345 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:09.022309 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:09.117675 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:09.117626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:09.117675 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:09.117677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:09.117914 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:09.117782 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 22:14:09.117914 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:14:09.117847 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls podName:5610c01c-4319-45be-9c57-de3d60626fb6 nodeName:}" failed. No retries permitted until 2026-07-13 22:14:17.117831742 +0000 UTC m=+61.721107947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fqvxz" (UID: "5610c01c-4319-45be-9c57-de3d60626fb6") : secret "insights-runtime-extractor-tls" not found Jul 13 22:14:09.118288 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:09.118269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5610c01c-4319-45be-9c57-de3d60626fb6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:09.864160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:09.864121 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:10.035637 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:10.035599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:10.459640 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:10.459608 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:10.622973 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:10.622942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:10.632820 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:10.632791 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:14:10.632928 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:10.632853 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:14:10.633309 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:10.633290 2581 scope.go:117] "RemoveContainer" containerID="2d0319691c2bd3357ce7b72906dcb4b4ed8cba6219d1a9461e21184b6054559f" Jul 13 22:14:11.203736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.203708 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:14:11.204176 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.203758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6qmcp" event={"ID":"3250ec47-e688-4bfb-9453-83722d21174c","Type":"ContainerStarted","Data":"c8c2aeff13c31c785965ec2bbef86817d0b6580beee11a0b539fc0435de980c3"} Jul 13 22:14:11.204176 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.204097 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:14:11.217636 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.217603 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-6qmcp" Jul 13 22:14:11.220985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.220939 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-6qmcp" podStartSLOduration=19.812080708 podStartE2EDuration="27.220923423s" totalImagesPullingTime="7.408842715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:11.219771355 +0000 UTC m=+55.823047586" watchObservedRunningTime="2026-07-13 22:14:11.220923423 +0000 UTC m=+55.824199650" Jul 13 22:14:11.481107 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.481006 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:11.604523 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.604496 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:11.704219 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.704180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:11.805261 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.805215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:11.876208 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:11.876170 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:12.053981 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:12.053947 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:12.154759 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:12.154669 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:12.255161 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:12.255121 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:12.336131 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:12.336103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:12.434153 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:12.434063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:12.534461 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:12.534405 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:12.897198 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:12.897165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:13.093291 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:13.093248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:13.421289 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:13.421227 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:13.523052 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:13.523003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:13.622962 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:13.622924 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:13.832548 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:13.832509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:13.894371 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:13.894332 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:14.024101 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:14.024065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:14.230727 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:14.230636 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:14.431187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:14.431135 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:14.530163 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:14.530128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:14.909732 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:14.909638 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:15.008143 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:15.008104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:15.238447 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:15.238330 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:15.637717 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:15.637681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:16.096187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:16.096149 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:16.102500 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:16.102477 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vskgc" Jul 13 22:14:16.263094 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:16.263062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:16.401936 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:16.401836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:16.843436 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:16.843394 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:17.198288 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:17.198197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:17.200505 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:17.200484 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5610c01c-4319-45be-9c57-de3d60626fb6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqvxz\" (UID: \"5610c01c-4319-45be-9c57-de3d60626fb6\") " pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:17.230855 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:17.230822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:17.250851 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:17.250819 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w5vtc\"" Jul 13 22:14:17.258774 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:17.258749 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fqvxz" Jul 13 22:14:17.396566 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:17.396525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fqvxz"] Jul 13 22:14:17.400815 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:17.400784 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5610c01c_4319_45be_9c57_de3d60626fb6.slice/crio-29ffcee24c3ec22e6b89ccb6d98a2a355676da98edb4ec7c690206c24e06a275 WatchSource:0}: Error finding container 29ffcee24c3ec22e6b89ccb6d98a2a355676da98edb4ec7c690206c24e06a275: Status 404 returned error can't find the container with id 29ffcee24c3ec22e6b89ccb6d98a2a355676da98edb4ec7c690206c24e06a275 Jul 13 22:14:17.625668 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:17.625636 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:18.040901 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:18.040331 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:18.227600 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:18.227561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqvxz" event={"ID":"5610c01c-4319-45be-9c57-de3d60626fb6","Type":"ContainerStarted","Data":"29ffcee24c3ec22e6b89ccb6d98a2a355676da98edb4ec7c690206c24e06a275"} Jul 13 22:14:18.429299 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:18.429198 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:18.631020 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:18.630975 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:18.828971 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:18.828937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:19.715983 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:19.715913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:19.816946 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:19.816899 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:21.239059 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.239030 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqvxz" event={"ID":"5610c01c-4319-45be-9c57-de3d60626fb6","Type":"ContainerStarted","Data":"73291ffe7cc87a6527fd86edbaa6f093c823aec741559474566360da16fdf795"} Jul 13 22:14:21.648222 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.648192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:14:21.648380 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.648237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:14:21.650321 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.650300 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 22:14:21.650439 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.650373 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 22:14:21.661408 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.661387 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec1a835-7c98-41a2-971f-39390a54adf3-original-pull-secret\") pod \"global-pull-secret-syncer-cvb5k\" (UID: \"eec1a835-7c98-41a2-971f-39390a54adf3\") " pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:14:21.661499 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.661408 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52ce273b-88d0-4597-9a08-4e59ccf7820d-metrics-certs\") pod \"network-metrics-daemon-8fp6d\" (UID: \"52ce273b-88d0-4597-9a08-4e59ccf7820d\") " pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:14:21.749810 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.749780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:14:21.752484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.752459 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2l7f\" (UniqueName: \"kubernetes.io/projected/b45ee4ea-8111-4745-9e66-4c1034f6f643-kube-api-access-q2l7f\") pod \"network-check-target-vpxg5\" (UID: \"b45ee4ea-8111-4745-9e66-4c1034f6f643\") " pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:14:21.817852 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.817824 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jtd57\"" Jul 13 22:14:21.820562 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.820543 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cvb5k" Jul 13 22:14:21.826307 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.826287 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8fp6d" Jul 13 22:14:21.915039 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.915004 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpxwn\"" Jul 13 22:14:21.923126 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.922922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:14:21.988782 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:21.988757 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cvb5k"] Jul 13 22:14:21.996379 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:21.996347 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec1a835_7c98_41a2_971f_39390a54adf3.slice/crio-b256d40e7fd9f6b730c21a913ba9c32b8e1d1b078132768bad922d40424e3ef2 WatchSource:0}: Error finding container b256d40e7fd9f6b730c21a913ba9c32b8e1d1b078132768bad922d40424e3ef2: Status 404 returned error can't find the container with id b256d40e7fd9f6b730c21a913ba9c32b8e1d1b078132768bad922d40424e3ef2 Jul 13 22:14:22.013954 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.013656 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8fp6d"] Jul 13 22:14:22.087441 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.087402 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vpxg5"] Jul 13 22:14:22.089883 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:22.089860 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45ee4ea_8111_4745_9e66_4c1034f6f643.slice/crio-9e2d06d7258b01ab91176a989b33611d8d4007d4f4d45a91a1312b7e0e82a959 WatchSource:0}: Error finding container 9e2d06d7258b01ab91176a989b33611d8d4007d4f4d45a91a1312b7e0e82a959: Status 404 returned error can't find the container with id 9e2d06d7258b01ab91176a989b33611d8d4007d4f4d45a91a1312b7e0e82a959 Jul 13 22:14:22.243622 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.243556 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqvxz" event={"ID":"5610c01c-4319-45be-9c57-de3d60626fb6","Type":"ContainerStarted","Data":"a932a1f70c8716da9279aa3d8ab9e230ccd065a47f54b8a46a9d7bc03ec88e77"} Jul 13 22:14:22.244696 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.244662 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8fp6d" event={"ID":"52ce273b-88d0-4597-9a08-4e59ccf7820d","Type":"ContainerStarted","Data":"d4c2c8026f2c9edc55006a0a13f4968913886e9cc03a9f3d37e79d9de54ddc78"} Jul 13 22:14:22.245950 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.245925 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vpxg5" event={"ID":"b45ee4ea-8111-4745-9e66-4c1034f6f643","Type":"ContainerStarted","Data":"56efe9e0186634fc96edfcec199aa870b3f8b421be15ea3723f45623b9194d13"} Jul 13 22:14:22.246061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.245968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vpxg5" event={"ID":"b45ee4ea-8111-4745-9e66-4c1034f6f643","Type":"ContainerStarted","Data":"9e2d06d7258b01ab91176a989b33611d8d4007d4f4d45a91a1312b7e0e82a959"} Jul 13 22:14:22.246061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.246031 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:14:22.247092 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.247073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cvb5k" event={"ID":"eec1a835-7c98-41a2-971f-39390a54adf3","Type":"ContainerStarted","Data":"b256d40e7fd9f6b730c21a913ba9c32b8e1d1b078132768bad922d40424e3ef2"} Jul 13 22:14:22.254222 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.254203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:14:22.254301 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.254232 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:22.254301 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.254250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:14:22.254301 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.254270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:22.254538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.254521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:14:22.254615 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.254555 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:14:22.254615 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.254589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:14:22.255094 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.255062 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/265ffc2b-2b91-406a-8533-4584e155db46-service-ca-bundle\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:22.256670 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.256643 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7c1d7c-3a57-4019-9187-2ef2524457cc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-w8mrc\" (UID: \"6a7c1d7c-3a57-4019-9187-2ef2524457cc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:14:22.257054 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.257030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c51dc89-77fb-438b-942b-9dc59ea1b869-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pkzgr\" (UID: \"0c51dc89-77fb-438b-942b-9dc59ea1b869\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:14:22.257054 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.257048 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03b29cad-a516-474c-a034-83c7db33f1a8-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8xqrn\" (UID: \"03b29cad-a516-474c-a034-83c7db33f1a8\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:14:22.257165 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.257062 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/265ffc2b-2b91-406a-8533-4584e155db46-metrics-certs\") pod \"router-default-5957f79d44-8gl4v\" (UID: \"265ffc2b-2b91-406a-8533-4584e155db46\") " pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:22.257200 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.257185 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ee5b6f-56b2-4956-a8de-8634b7830187-metrics-tls\") pod \"dns-default-j8rtz\" (UID: \"c1ee5b6f-56b2-4956-a8de-8634b7830187\") " pod="openshift-dns/dns-default-j8rtz" Jul 13 22:14:22.257285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.257261 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"image-registry-77fdc59dd4-8pjvz\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:14:22.263595 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.263554 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vpxg5" podStartSLOduration=66.263541416 podStartE2EDuration="1m6.263541416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:22.262339606 +0000 UTC m=+66.865615835" watchObservedRunningTime="2026-07-13 22:14:22.263541416 +0000 UTC m=+66.866817635" Jul 13 22:14:22.366905 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.366887 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k2hpl\"" Jul 13 22:14:22.374754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.374736 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:22.375703 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.375689 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zb4qz\"" Jul 13 22:14:22.384352 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.384339 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:14:22.396578 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.396557 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vm4v7\"" Jul 13 22:14:22.403853 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.403837 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dxf4c\"" Jul 13 22:14:22.404883 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.404868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" Jul 13 22:14:22.411473 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.411455 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" Jul 13 22:14:22.443126 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.443105 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p77sr\"" Jul 13 22:14:22.450921 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.450896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8rtz" Jul 13 22:14:22.467336 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.467252 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rbmzp\"" Jul 13 22:14:22.474143 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.474059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" Jul 13 22:14:22.553753 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.553610 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5957f79d44-8gl4v"] Jul 13 22:14:22.603333 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.603265 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77fdc59dd4-8pjvz"] Jul 13 22:14:22.655688 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.651534 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc"] Jul 13 22:14:22.699695 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.698274 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr"] Jul 13 22:14:22.704834 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:22.704770 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c51dc89_77fb_438b_942b_9dc59ea1b869.slice/crio-d5a0b9061ecdcbdaa6f12c9630271d5632c42d32793ec8332e956b45a662af31 WatchSource:0}: Error finding container d5a0b9061ecdcbdaa6f12c9630271d5632c42d32793ec8332e956b45a662af31: Status 404 returned error can't find the container with id d5a0b9061ecdcbdaa6f12c9630271d5632c42d32793ec8332e956b45a662af31 Jul 13 22:14:22.727117 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.727058 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8xqrn"] Jul 13 22:14:22.734209 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:22.734179 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b29cad_a516_474c_a034_83c7db33f1a8.slice/crio-9429ff814185104ebf37116fc3854f34f377d753588d984ba99828ffa2cf1c69 WatchSource:0}: Error finding container 9429ff814185104ebf37116fc3854f34f377d753588d984ba99828ffa2cf1c69: Status 404 returned error can't find the container with id 9429ff814185104ebf37116fc3854f34f377d753588d984ba99828ffa2cf1c69 Jul 13 22:14:22.745749 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:22.745681 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8rtz"] Jul 13 22:14:22.749255 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:22.749223 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ee5b6f_56b2_4956_a8de_8634b7830187.slice/crio-a7bafebdaedba0a600046d5b3cc3388bbd7ee17a506bc2916ff1cd216aa6b4b2 WatchSource:0}: Error finding container a7bafebdaedba0a600046d5b3cc3388bbd7ee17a506bc2916ff1cd216aa6b4b2: Status 404 returned error can't find the container with id a7bafebdaedba0a600046d5b3cc3388bbd7ee17a506bc2916ff1cd216aa6b4b2 Jul 13 22:14:23.256398 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.255694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5957f79d44-8gl4v" event={"ID":"265ffc2b-2b91-406a-8533-4584e155db46","Type":"ContainerStarted","Data":"37818413c0291ba5f3e5ba7fd51a1d65655b05ecf5b0989fea0506b07e5af77f"} Jul 13 22:14:23.256398 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.255756 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5957f79d44-8gl4v" event={"ID":"265ffc2b-2b91-406a-8533-4584e155db46","Type":"ContainerStarted","Data":"e3dd75b674fed4917436ae72b1c8722545825aeacffc774880b9eb0865b90477"} Jul 13 22:14:23.259603 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.259575 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" event={"ID":"0c51dc89-77fb-438b-942b-9dc59ea1b869","Type":"ContainerStarted","Data":"d5a0b9061ecdcbdaa6f12c9630271d5632c42d32793ec8332e956b45a662af31"} Jul 13 22:14:23.262254 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.262172 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" event={"ID":"6a7c1d7c-3a57-4019-9187-2ef2524457cc","Type":"ContainerStarted","Data":"a728c84c2abf772e0ab61dd85222945eb90cf430bed2b17190dd0a9866b69d30"} Jul 13 22:14:23.264765 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.264720 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" event={"ID":"03b29cad-a516-474c-a034-83c7db33f1a8","Type":"ContainerStarted","Data":"9429ff814185104ebf37116fc3854f34f377d753588d984ba99828ffa2cf1c69"} Jul 13 22:14:23.266473 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.266414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8rtz" event={"ID":"c1ee5b6f-56b2-4956-a8de-8634b7830187","Type":"ContainerStarted","Data":"a7bafebdaedba0a600046d5b3cc3388bbd7ee17a506bc2916ff1cd216aa6b4b2"} Jul 13 22:14:23.269955 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.269562 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" event={"ID":"c5106856-9233-4bce-b2b3-f53b968de11a","Type":"ContainerStarted","Data":"c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2"} Jul 13 22:14:23.269955 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.269599 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" event={"ID":"c5106856-9233-4bce-b2b3-f53b968de11a","Type":"ContainerStarted","Data":"272dbf46e4359c649fee895d4ea813d4caa906210a893ce3d13e56627b3517b6"} Jul 13 22:14:23.279557 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.278151 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5957f79d44-8gl4v" podStartSLOduration=39.278133932 podStartE2EDuration="39.278133932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:23.27636575 +0000 UTC m=+67.879642006" watchObservedRunningTime="2026-07-13 22:14:23.278133932 +0000 UTC m=+67.881410160" Jul 13 22:14:23.297926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.297873 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" podStartSLOduration=67.297855681 podStartE2EDuration="1m7.297855681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:23.296161433 +0000 UTC m=+67.899437661" watchObservedRunningTime="2026-07-13 22:14:23.297855681 +0000 UTC m=+67.901131889" Jul 13 22:14:23.375218 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.375190 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:23.378677 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:23.378648 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:24.280004 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:24.279496 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8fp6d" event={"ID":"52ce273b-88d0-4597-9a08-4e59ccf7820d","Type":"ContainerStarted","Data":"dc9c85db24119c55906ff3ca2ebe495ea8cad687b4ccfd94245b9397b7358052"} Jul 13 22:14:24.280004 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:24.279561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8fp6d" event={"ID":"52ce273b-88d0-4597-9a08-4e59ccf7820d","Type":"ContainerStarted","Data":"a756efb76a83a526f85782e5c2c7db7ca0c1a6031473e19f4f59d16c38ee4736"} Jul 13 22:14:24.280517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:24.280446 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:24.280725 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:24.280681 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:14:24.282881 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:24.282044 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5957f79d44-8gl4v" Jul 13 22:14:24.295616 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:24.295565 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8fp6d" podStartSLOduration=66.613475263 podStartE2EDuration="1m8.295547286s" totalImagesPullingTime="1.682072023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:24.294356836 +0000 UTC m=+68.897633064" watchObservedRunningTime="2026-07-13 22:14:24.295547286 +0000 UTC m=+68.898823515" Jul 13 22:14:25.373812 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.372686 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7"] Jul 13 22:14:25.425516 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.425473 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7"] Jul 13 22:14:25.425863 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.425837 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.428599 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.428576 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 22:14:25.429173 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.429018 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 22:14:25.429173 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.429025 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 13 22:14:25.429382 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.429320 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 22:14:25.470703 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.470654 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:25.482786 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.482763 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fc4d68859-cbl8g"] Jul 13 22:14:25.485392 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.485195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgxqw\" (UniqueName: \"kubernetes.io/projected/7a996a79-e2b1-4a5e-a454-ffa37e547856-kube-api-access-tgxqw\") pod \"klusterlet-addon-workmgr-5487d996c-g7fh7\" (UID: \"7a996a79-e2b1-4a5e-a454-ffa37e547856\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.485392 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.485283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a996a79-e2b1-4a5e-a454-ffa37e547856-klusterlet-config\") pod \"klusterlet-addon-workmgr-5487d996c-g7fh7\" (UID: \"7a996a79-e2b1-4a5e-a454-ffa37e547856\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.485392 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.485328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a996a79-e2b1-4a5e-a454-ffa37e547856-tmp\") pod \"klusterlet-addon-workmgr-5487d996c-g7fh7\" (UID: \"7a996a79-e2b1-4a5e-a454-ffa37e547856\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.512116 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.512075 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-pgrjd"] Jul 13 22:14:25.512250 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.512190 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.516316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.516295 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 22:14:25.516479 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.516391 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 22:14:25.516479 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.516410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 22:14:25.518754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.516577 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 22:14:25.518754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.516660 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 22:14:25.518754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.516921 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lvv74\"" Jul 13 22:14:25.518754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.516957 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 22:14:25.520353 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.520335 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 22:14:25.528611 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.528590 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-pgrjd"] Jul 13 22:14:25.528730 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.528628 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc4d68859-cbl8g"] Jul 13 22:14:25.528730 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.528711 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-pgrjd" Jul 13 22:14:25.530609 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.530583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jmbh5\"" Jul 13 22:14:25.585832 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.585799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbh78\" (UniqueName: \"kubernetes.io/projected/d85866af-7e9d-4c2c-988e-bd6719022955-kube-api-access-tbh78\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.585978 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.585844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-oauth-serving-cert\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.585978 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.585928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a996a79-e2b1-4a5e-a454-ffa37e547856-klusterlet-config\") pod \"klusterlet-addon-workmgr-5487d996c-g7fh7\" (UID: \"7a996a79-e2b1-4a5e-a454-ffa37e547856\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.585978 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.585967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-serving-cert\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.586140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.586001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a996a79-e2b1-4a5e-a454-ffa37e547856-tmp\") pod \"klusterlet-addon-workmgr-5487d996c-g7fh7\" (UID: \"7a996a79-e2b1-4a5e-a454-ffa37e547856\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.586140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.586034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-oauth-config\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.586140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.586051 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-console-config\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.586140 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.586132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-service-ca\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.586334 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.586163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxqw\" (UniqueName: \"kubernetes.io/projected/7a996a79-e2b1-4a5e-a454-ffa37e547856-kube-api-access-tgxqw\") pod \"klusterlet-addon-workmgr-5487d996c-g7fh7\" (UID: \"7a996a79-e2b1-4a5e-a454-ffa37e547856\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.586334 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.586230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj784\" (UniqueName: \"kubernetes.io/projected/d64f3a9a-85e2-4452-b491-f3ee90e74ebf-kube-api-access-qj784\") pod \"downloads-68c9cbb497-pgrjd\" (UID: \"d64f3a9a-85e2-4452-b491-f3ee90e74ebf\") " pod="openshift-console/downloads-68c9cbb497-pgrjd" Jul 13 22:14:25.586464 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.586404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a996a79-e2b1-4a5e-a454-ffa37e547856-tmp\") pod \"klusterlet-addon-workmgr-5487d996c-g7fh7\" (UID: \"7a996a79-e2b1-4a5e-a454-ffa37e547856\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.588888 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.588868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a996a79-e2b1-4a5e-a454-ffa37e547856-klusterlet-config\") pod \"klusterlet-addon-workmgr-5487d996c-g7fh7\" (UID: \"7a996a79-e2b1-4a5e-a454-ffa37e547856\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.612436 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.612273 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:25.618637 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.618576 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgxqw\" (UniqueName: \"kubernetes.io/projected/7a996a79-e2b1-4a5e-a454-ffa37e547856-kube-api-access-tgxqw\") pod \"klusterlet-addon-workmgr-5487d996c-g7fh7\" (UID: \"7a996a79-e2b1-4a5e-a454-ffa37e547856\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.632400 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.632339 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d949b67b-4kgmr"] Jul 13 22:14:25.686703 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.686668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-serving-cert\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.686852 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.686737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-oauth-config\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.686852 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.686764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-console-config\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.686852 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.686792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-service-ca\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.686852 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.686847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj784\" (UniqueName: \"kubernetes.io/projected/d64f3a9a-85e2-4452-b491-f3ee90e74ebf-kube-api-access-qj784\") pod \"downloads-68c9cbb497-pgrjd\" (UID: \"d64f3a9a-85e2-4452-b491-f3ee90e74ebf\") " pod="openshift-console/downloads-68c9cbb497-pgrjd" Jul 13 22:14:25.687078 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.686872 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d949b67b-4kgmr"] Jul 13 22:14:25.687078 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.686881 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbh78\" (UniqueName: \"kubernetes.io/projected/d85866af-7e9d-4c2c-988e-bd6719022955-kube-api-access-tbh78\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.687078 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.686961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-oauth-serving-cert\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.687807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.687333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.687807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.687748 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-oauth-serving-cert\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.687974 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.687907 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-service-ca\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.688070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.688034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-console-config\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.690495 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.690471 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-oauth-config\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.690602 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.690511 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-serving-cert\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.696036 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.696014 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 22:14:25.704245 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.704219 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj784\" (UniqueName: \"kubernetes.io/projected/d64f3a9a-85e2-4452-b491-f3ee90e74ebf-kube-api-access-qj784\") pod \"downloads-68c9cbb497-pgrjd\" (UID: \"d64f3a9a-85e2-4452-b491-f3ee90e74ebf\") " pod="openshift-console/downloads-68c9cbb497-pgrjd" Jul 13 22:14:25.707391 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.707370 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbh78\" (UniqueName: \"kubernetes.io/projected/d85866af-7e9d-4c2c-988e-bd6719022955-kube-api-access-tbh78\") pod \"console-5fc4d68859-cbl8g\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.738993 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.738960 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:25.746443 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.746400 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:25.787257 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.787232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-serving-cert\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.787257 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.787259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-config\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.787403 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.787278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-oauth-serving-cert\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.787403 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.787305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwh7x\" (UniqueName: \"kubernetes.io/projected/7eab1f21-79f5-4784-a61c-d3e63e2b207b-kube-api-access-wwh7x\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.787403 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.787379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-trusted-ca-bundle\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.787535 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.787454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-oauth-config\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.787535 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.787479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-service-ca\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.825780 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.825747 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:25.838927 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.838904 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-pgrjd" Jul 13 22:14:25.839398 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.839367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:25.887848 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.887786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-oauth-config\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.887848 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.887818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-service-ca\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.887848 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.887841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-serving-cert\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.888048 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.887855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-config\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.888048 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.887874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-oauth-serving-cert\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.888048 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.887926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh7x\" (UniqueName: \"kubernetes.io/projected/7eab1f21-79f5-4784-a61c-d3e63e2b207b-kube-api-access-wwh7x\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.888048 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.887980 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-trusted-ca-bundle\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.888637 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.888588 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-service-ca\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.888637 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.888600 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-config\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.889005 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.888983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-oauth-serving-cert\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.889092 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.889073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-trusted-ca-bundle\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.890368 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.890342 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-oauth-config\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.890469 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.890457 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-serving-cert\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.898016 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.897994 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwh7x\" (UniqueName: \"kubernetes.io/projected/7eab1f21-79f5-4784-a61c-d3e63e2b207b-kube-api-access-wwh7x\") pod \"console-6d949b67b-4kgmr\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:25.940266 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:25.940231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:26.022297 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:26.022268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:26.379217 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:26.379187 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:26.438541 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:26.438507 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:26.781876 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:26.781832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:26.881765 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:26.881725 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:29.864947 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:29.864905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:29.919665 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:29.919634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:30.506594 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:30.506505 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7"] Jul 13 22:14:30.748942 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:30.748913 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-pgrjd"] Jul 13 22:14:30.751957 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:30.751929 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d949b67b-4kgmr"] Jul 13 22:14:30.752933 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:30.752913 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc4d68859-cbl8g"] Jul 13 22:14:30.753091 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:30.752929 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64f3a9a_85e2_4452_b491_f3ee90e74ebf.slice/crio-e6cf12b2bced0d80a8c2f480f582b2043f3b9c71ce34dc46207b7ebf0fb7ebb5 WatchSource:0}: Error finding container e6cf12b2bced0d80a8c2f480f582b2043f3b9c71ce34dc46207b7ebf0fb7ebb5: Status 404 returned error can't find the container with id e6cf12b2bced0d80a8c2f480f582b2043f3b9c71ce34dc46207b7ebf0fb7ebb5 Jul 13 22:14:30.756554 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:30.756522 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85866af_7e9d_4c2c_988e_bd6719022955.slice/crio-d213c453c0b2d2a6ee816a92fb612a05921c407f209af803523055e2dcb6d5ef WatchSource:0}: Error finding container d213c453c0b2d2a6ee816a92fb612a05921c407f209af803523055e2dcb6d5ef: Status 404 returned error can't find the container with id d213c453c0b2d2a6ee816a92fb612a05921c407f209af803523055e2dcb6d5ef Jul 13 22:14:30.757327 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:30.757306 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eab1f21_79f5_4784_a61c_d3e63e2b207b.slice/crio-8685d180929f472728e1e64385c4d9e2218c7ce726a9fe08189e5f53d4f66fbc WatchSource:0}: Error finding container 8685d180929f472728e1e64385c4d9e2218c7ce726a9fe08189e5f53d4f66fbc: Status 404 returned error can't find the container with id 8685d180929f472728e1e64385c4d9e2218c7ce726a9fe08189e5f53d4f66fbc Jul 13 22:14:30.822180 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:30.822143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:30.915567 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:30.915532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:31.008265 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.008236 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:31.076244 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.076213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:31.140986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.140951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:31.306904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.306873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" event={"ID":"03b29cad-a516-474c-a034-83c7db33f1a8","Type":"ContainerStarted","Data":"e0d3e5a8bc8bbccb714612f30dd753e20f22319b65a2702f0f6d0867b45a1966"} Jul 13 22:14:31.308665 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.308642 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8rtz" event={"ID":"c1ee5b6f-56b2-4956-a8de-8634b7830187","Type":"ContainerStarted","Data":"485a10be0e039b026b1fef33e482272b4fd89f21f813f0d0c2d8ee5703494744"} Jul 13 22:14:31.308779 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.308684 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8rtz" event={"ID":"c1ee5b6f-56b2-4956-a8de-8634b7830187","Type":"ContainerStarted","Data":"e757a8195a549a4cf0beee2e49f21affd658a30e9dc1f107ea20c60510d31a13"} Jul 13 22:14:31.308779 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.308715 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j8rtz" Jul 13 22:14:31.309857 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.309837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d949b67b-4kgmr" event={"ID":"7eab1f21-79f5-4784-a61c-d3e63e2b207b","Type":"ContainerStarted","Data":"8685d180929f472728e1e64385c4d9e2218c7ce726a9fe08189e5f53d4f66fbc"} Jul 13 22:14:31.311279 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.311257 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" event={"ID":"0c51dc89-77fb-438b-942b-9dc59ea1b869","Type":"ContainerStarted","Data":"c167bf5f795ceddfda9f216f85199f2f47e2a3aa09bac9394db43ae3fb9ea5bd"} Jul 13 22:14:31.313248 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.313227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqvxz" event={"ID":"5610c01c-4319-45be-9c57-de3d60626fb6","Type":"ContainerStarted","Data":"2028a103ee7d3049c08d51d7d979682c86ecca18d3c009b6ac2b4313240f20e0"} Jul 13 22:14:31.314384 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.314366 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" event={"ID":"7a996a79-e2b1-4a5e-a454-ffa37e547856","Type":"ContainerStarted","Data":"df05d59f74f82318e729d5cbf74858f9195a4e661bae852789ce90399e22db44"} Jul 13 22:14:31.315650 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.315630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cvb5k" event={"ID":"eec1a835-7c98-41a2-971f-39390a54adf3","Type":"ContainerStarted","Data":"bc2ecd1b85526320669c6a7c796908746c2746847e101fbce5d7538c162f7bdb"} Jul 13 22:14:31.316741 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.316722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-pgrjd" event={"ID":"d64f3a9a-85e2-4452-b491-f3ee90e74ebf","Type":"ContainerStarted","Data":"e6cf12b2bced0d80a8c2f480f582b2043f3b9c71ce34dc46207b7ebf0fb7ebb5"} Jul 13 22:14:31.317872 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.317852 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc4d68859-cbl8g" event={"ID":"d85866af-7e9d-4c2c-988e-bd6719022955","Type":"ContainerStarted","Data":"d213c453c0b2d2a6ee816a92fb612a05921c407f209af803523055e2dcb6d5ef"} Jul 13 22:14:31.319340 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.319321 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" event={"ID":"6a7c1d7c-3a57-4019-9187-2ef2524457cc","Type":"ContainerStarted","Data":"77e1ce5336be08fe581833e23b6fb6c4fc145587caa3f81e151815a387c0610f"} Jul 13 22:14:31.319431 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.319357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" event={"ID":"6a7c1d7c-3a57-4019-9187-2ef2524457cc","Type":"ContainerStarted","Data":"28953827bc2f53e22bd9f0610d5dbe832243c5faaa2c2085f5c0d7b331387227"} Jul 13 22:14:31.326126 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.326085 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-8xqrn" podStartSLOduration=38.735364964 podStartE2EDuration="46.326073659s" totalImagesPullingTime="7.590708695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:31.32528233 +0000 UTC m=+75.928558558" watchObservedRunningTime="2026-07-13 22:14:31.326073659 +0000 UTC m=+75.929349885" Jul 13 22:14:31.343339 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.343299 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-w8mrc" podStartSLOduration=39.748490149 podStartE2EDuration="47.343285937s" totalImagesPullingTime="7.594795788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:31.34237979 +0000 UTC m=+75.945656018" watchObservedRunningTime="2026-07-13 22:14:31.343285937 +0000 UTC m=+75.946562164" Jul 13 22:14:31.366544 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.366503 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pkzgr" podStartSLOduration=39.748273119 podStartE2EDuration="47.366490318s" totalImagesPullingTime="7.618217199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:31.365727286 +0000 UTC m=+75.969003514" watchObservedRunningTime="2026-07-13 22:14:31.366490318 +0000 UTC m=+75.969766545" Jul 13 22:14:31.384067 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.384027 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fqvxz" podStartSLOduration=17.637309369 podStartE2EDuration="30.384012873s" totalImagesPullingTime="12.746703504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:14:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:31.383710576 +0000 UTC m=+75.986986794" watchObservedRunningTime="2026-07-13 22:14:31.384012873 +0000 UTC m=+75.987289108" Jul 13 22:14:31.400119 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.400070 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cvb5k" podStartSLOduration=67.054595678 podStartE2EDuration="1m15.400055289s" totalImagesPullingTime="8.345459611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:31.397087279 +0000 UTC m=+76.000363510" watchObservedRunningTime="2026-07-13 22:14:31.400055289 +0000 UTC m=+76.003331517" Jul 13 22:14:31.415499 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.415461 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j8rtz" podStartSLOduration=33.83383089 podStartE2EDuration="41.415449359s" totalImagesPullingTime="7.581618469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:31.414730351 +0000 UTC m=+76.018006578" watchObservedRunningTime="2026-07-13 22:14:31.415449359 +0000 UTC m=+76.018725585" Jul 13 22:14:31.460235 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.460206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:31.529241 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.529208 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:31.598917 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.598833 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:31.700318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:31.700248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:33.947188 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:33.947155 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:34.020868 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:34.020831 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:34.325363 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:34.325152 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:34.389771 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:34.389736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:37.350973 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.350842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d949b67b-4kgmr" event={"ID":"7eab1f21-79f5-4784-a61c-d3e63e2b207b","Type":"ContainerStarted","Data":"f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd"} Jul 13 22:14:37.353017 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.352985 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" event={"ID":"7a996a79-e2b1-4a5e-a454-ffa37e547856","Type":"ContainerStarted","Data":"c8862346161ba1e2ecbd91955a0d1ccc5c050cd0940f5112e311024daf52cce8"} Jul 13 22:14:37.353214 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.353160 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:37.354833 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.354815 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" Jul 13 22:14:37.356522 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.356476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc4d68859-cbl8g" event={"ID":"d85866af-7e9d-4c2c-988e-bd6719022955","Type":"ContainerStarted","Data":"1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670"} Jul 13 22:14:37.374276 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.374232 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d949b67b-4kgmr" podStartSLOduration=6.422821565 podStartE2EDuration="12.374220053s" totalImagesPullingTime="5.951398488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:37.372805113 +0000 UTC m=+81.976081342" watchObservedRunningTime="2026-07-13 22:14:37.374220053 +0000 UTC m=+81.977496277" Jul 13 22:14:37.393059 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.393014 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5487d996c-g7fh7" podStartSLOduration=6.19980794 podStartE2EDuration="12.393002149s" totalImagesPullingTime="6.193194209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:37.391897603 +0000 UTC m=+81.995173830" watchObservedRunningTime="2026-07-13 22:14:37.393002149 +0000 UTC m=+81.996278377" Jul 13 22:14:37.417203 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.417166 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fc4d68859-cbl8g" podStartSLOduration=6.459774184 podStartE2EDuration="12.417153503s" totalImagesPullingTime="5.957379319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:37.415628409 +0000 UTC m=+82.018904636" watchObservedRunningTime="2026-07-13 22:14:37.417153503 +0000 UTC m=+82.020429790" Jul 13 22:14:37.591672 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.591637 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:37.687544 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:37.687442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:38.817958 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:38.817921 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:38.916483 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:38.916442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:39.016104 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:39.016063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:39.093291 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:39.093139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:39.497163 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:39.497067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:41.328656 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:41.328622 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j8rtz" Jul 13 22:14:43.015849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:43.015794 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:43.079189 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:43.079143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:43.970158 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:43.970117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:44.071542 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.071494 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:44.219012 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.218966 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:44.337266 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.337231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:44.456624 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.456589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:44.531623 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.531588 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fh9zf"] Jul 13 22:14:44.534932 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.534906 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.538613 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.538583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 22:14:44.539133 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.539113 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 22:14:44.539260 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.539156 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 22:14:44.539326 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.539260 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 22:14:44.539326 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.539293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q65jt\"" Jul 13 22:14:44.560408 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.560385 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:44.634882 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.634788 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:44.640347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.640318 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-accelerators-collector-config\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.640517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.640360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-wtmp\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.640517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.640452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcfb3347-e15c-41eb-86ac-1b314a11844a-sys\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.640517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.640488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxzws\" (UniqueName: \"kubernetes.io/projected/dcfb3347-e15c-41eb-86ac-1b314a11844a-kube-api-access-jxzws\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.640686 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.640565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcfb3347-e15c-41eb-86ac-1b314a11844a-metrics-client-ca\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.640686 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.640634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dcfb3347-e15c-41eb-86ac-1b314a11844a-root\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.640686 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.640659 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.640686 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.640678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-textfile\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.640886 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.640691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-tls\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.741753 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.741714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxzws\" (UniqueName: \"kubernetes.io/projected/dcfb3347-e15c-41eb-86ac-1b314a11844a-kube-api-access-jxzws\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.741926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.741797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcfb3347-e15c-41eb-86ac-1b314a11844a-metrics-client-ca\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.741926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.741851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dcfb3347-e15c-41eb-86ac-1b314a11844a-root\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.741926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.741876 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.741926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.741904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-textfile\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.741926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.741927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-tls\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.742195 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.741961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-accelerators-collector-config\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.742195 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.741986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-wtmp\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.742195 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.742011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcfb3347-e15c-41eb-86ac-1b314a11844a-sys\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.742195 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.742071 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dcfb3347-e15c-41eb-86ac-1b314a11844a-root\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.742195 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.742085 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcfb3347-e15c-41eb-86ac-1b314a11844a-sys\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.742467 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.742200 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-wtmp\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.742556 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.742501 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcfb3347-e15c-41eb-86ac-1b314a11844a-metrics-client-ca\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.743335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.743306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-textfile\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.743477 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.743458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-accelerators-collector-config\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.745099 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.745065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-tls\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.745203 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.745065 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcfb3347-e15c-41eb-86ac-1b314a11844a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.753538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.753497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxzws\" (UniqueName: \"kubernetes.io/projected/dcfb3347-e15c-41eb-86ac-1b314a11844a-kube-api-access-jxzws\") pod \"node-exporter-fh9zf\" (UID: \"dcfb3347-e15c-41eb-86ac-1b314a11844a\") " pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.793785 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.793712 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:44.846407 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.846376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fh9zf" Jul 13 22:14:44.894555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.894483 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:44.994823 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:44.994784 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:45.252387 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.252351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:45.288577 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.288549 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:14:45.358962 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.358926 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:45.480303 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.480247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:45.702867 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.702787 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:45.803946 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.803913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:45.825991 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.825964 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:45.826134 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.826016 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:45.831536 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.831515 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:45.949486 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:45.949454 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:46.022517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.022464 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:46.022517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.022517 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:46.028709 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.028687 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:46.399503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.399415 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:14:46.400101 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.399925 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:14:46.478084 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.478030 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc4d68859-cbl8g"] Jul 13 22:14:46.577401 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.577366 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:46.678345 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.678178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:46.789248 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.789203 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:46.884965 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:46.884923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:47.447831 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:47.447793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:47.553341 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:47.553296 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:47.701765 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:47.701658 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:47.814920 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:47.814885 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77fdc59dd4-8pjvz"] Jul 13 22:14:47.895739 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:47.895704 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:47.960716 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:47.960391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:48.027885 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:48.027845 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:49.247411 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:49.247380 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:49.319001 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:49.318965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:49.448232 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:49.448171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:49.547079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:49.547042 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:49.934670 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:49.934572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:50.269976 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:50.269936 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:50.383317 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:50.383284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:50.499047 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:50.499010 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:50.599487 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:50.599405 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:50.713718 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:14:50.713691 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcfb3347_e15c_41eb_86ac_1b314a11844a.slice/crio-272ea28eb81745242b79456b78a3c5bd0369eb4490c2190fda5e4f030a1c9ac6 WatchSource:0}: Error finding container 272ea28eb81745242b79456b78a3c5bd0369eb4490c2190fda5e4f030a1c9ac6: Status 404 returned error can't find the container with id 272ea28eb81745242b79456b78a3c5bd0369eb4490c2190fda5e4f030a1c9ac6 Jul 13 22:14:50.904716 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:50.904609 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:51.422169 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:51.422127 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fh9zf" event={"ID":"dcfb3347-e15c-41eb-86ac-1b314a11844a","Type":"ContainerStarted","Data":"272ea28eb81745242b79456b78a3c5bd0369eb4490c2190fda5e4f030a1c9ac6"} Jul 13 22:14:51.424815 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:51.424773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-pgrjd" event={"ID":"d64f3a9a-85e2-4452-b491-f3ee90e74ebf","Type":"ContainerStarted","Data":"2705200e049264ef853ea4d6827491d7396dd4427e5054391e64151c18c02544"} Jul 13 22:14:51.425057 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:51.425039 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-pgrjd" Jul 13 22:14:51.426520 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:51.426489 2581 patch_prober.go:28] interesting pod/downloads-68c9cbb497-pgrjd container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.22:8080/\": dial tcp 10.132.0.22:8080: connect: connection refused" start-of-body= Jul 13 22:14:51.426635 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:51.426561 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-pgrjd" podUID="d64f3a9a-85e2-4452-b491-f3ee90e74ebf" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.22:8080/\": dial tcp 10.132.0.22:8080: connect: connection refused" Jul 13 22:14:52.431232 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:52.431191 2581 generic.go:356] "Generic (PLEG): container finished" podID="dcfb3347-e15c-41eb-86ac-1b314a11844a" containerID="0b7be1b3451b3f67cda11744ac55df48f089bdee0b784bc1cb268204c09d1637" exitCode=0 Jul 13 22:14:52.431725 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:52.431291 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fh9zf" event={"ID":"dcfb3347-e15c-41eb-86ac-1b314a11844a","Type":"ContainerDied","Data":"0b7be1b3451b3f67cda11744ac55df48f089bdee0b784bc1cb268204c09d1637"} Jul 13 22:14:52.447708 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:52.447685 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-pgrjd" Jul 13 22:14:52.450671 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:52.450622 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-pgrjd" podStartSLOduration=7.15298139 podStartE2EDuration="27.450605372s" totalImagesPullingTime="20.297623982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:51.442323307 +0000 UTC m=+96.045599534" watchObservedRunningTime="2026-07-13 22:14:52.450605372 +0000 UTC m=+97.053881605" Jul 13 22:14:53.272491 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:53.272453 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vpxg5" Jul 13 22:14:53.438903 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:53.438862 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fh9zf" event={"ID":"dcfb3347-e15c-41eb-86ac-1b314a11844a","Type":"ContainerStarted","Data":"30d05f0cf11d8b0bcd56964dc8f7308661a215dea94a303006a8f9db841d6db4"} Jul 13 22:14:53.439333 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:53.438923 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fh9zf" event={"ID":"dcfb3347-e15c-41eb-86ac-1b314a11844a","Type":"ContainerStarted","Data":"55ca52c28487a88106176b13ce01d060088d8412e846a8cc4b765d62027d458f"} Jul 13 22:14:53.456606 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:53.456549 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fh9zf" podStartSLOduration=8.075403126 podStartE2EDuration="9.456530498s" totalImagesPullingTime="1.263829874s" totalInitContainerRuntime="117.297498ms" isStatefulPod=true podCreationTimestamp="2026-07-13 22:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:14:53.45474701 +0000 UTC m=+98.058023238" watchObservedRunningTime="2026-07-13 22:14:53.456530498 +0000 UTC m=+98.059806726" Jul 13 22:14:54.126953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:54.126912 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:54.226801 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:54.226761 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:57.239594 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:57.239548 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:57.339838 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:57.339803 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:57.439877 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:57.439839 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:59.465938 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:59.465903 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:59.529679 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:59.529361 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:59.859824 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:59.859785 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:14:59.913539 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:14:59.913506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:00.182094 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:00.182021 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d949b67b-4kgmr"] Jul 13 22:15:00.288260 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:00.288215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:00.389760 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:00.389730 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:00.451583 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:00.451510 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:03.097355 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:03.097321 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:05.488005 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:05.487923 2581 generic.go:356] "Generic (PLEG): container finished" podID="d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7" containerID="a226c0e033afca3d565613ef96a5e8bd19e008fc0822acc54ac446dd238e0209" exitCode=0 Jul 13 22:15:05.488005 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:05.487970 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" event={"ID":"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7","Type":"ContainerDied","Data":"a226c0e033afca3d565613ef96a5e8bd19e008fc0822acc54ac446dd238e0209"} Jul 13 22:15:05.488415 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:05.488288 2581 scope.go:117] "RemoveContainer" containerID="a226c0e033afca3d565613ef96a5e8bd19e008fc0822acc54ac446dd238e0209" Jul 13 22:15:06.493235 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:06.493199 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-rvb94" event={"ID":"d06f9c96-e1d4-4bfe-9d1c-2b09a5cbc6b7","Type":"ContainerStarted","Data":"8456a8ef87e857ee1c929bde094a39c7ba31d74e2fa84bf9827026c64b2be366"} Jul 13 22:15:10.509917 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:10.509876 2581 generic.go:356] "Generic (PLEG): container finished" podID="0c98ef70-1761-4133-be89-3f213b9af5d6" containerID="4a76c47db6991fc50dbc0f152fb9aa7a2c3af9b111166671a87ca307aa42715a" exitCode=0 Jul 13 22:15:10.510372 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:10.509946 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" event={"ID":"0c98ef70-1761-4133-be89-3f213b9af5d6","Type":"ContainerDied","Data":"4a76c47db6991fc50dbc0f152fb9aa7a2c3af9b111166671a87ca307aa42715a"} Jul 13 22:15:10.510443 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:10.510377 2581 scope.go:117] "RemoveContainer" containerID="4a76c47db6991fc50dbc0f152fb9aa7a2c3af9b111166671a87ca307aa42715a" Jul 13 22:15:10.511569 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:10.511547 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f04bca0-c73d-4ac2-971c-37b9596d5d53" containerID="00a480fbd8b8d9a61fe00fa21446b77f2c2124466ef7309487d278e9e2518d33" exitCode=0 Jul 13 22:15:10.511642 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:10.511621 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" event={"ID":"0f04bca0-c73d-4ac2-971c-37b9596d5d53","Type":"ContainerDied","Data":"00a480fbd8b8d9a61fe00fa21446b77f2c2124466ef7309487d278e9e2518d33"} Jul 13 22:15:10.511927 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:10.511914 2581 scope.go:117] "RemoveContainer" containerID="00a480fbd8b8d9a61fe00fa21446b77f2c2124466ef7309487d278e9e2518d33" Jul 13 22:15:11.518158 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:11.518114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-sn86f" event={"ID":"0c98ef70-1761-4133-be89-3f213b9af5d6","Type":"ContainerStarted","Data":"ef6672494640c77940cc85b2ac171471785da28ba7987435d2d473a83795e44f"} Jul 13 22:15:11.519973 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:11.519944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jhjjc" event={"ID":"0f04bca0-c73d-4ac2-971c-37b9596d5d53","Type":"ContainerStarted","Data":"fad7702460e5c1331e2d04766fb3c7961727f44b4a25d0e6e943631361936b5d"} Jul 13 22:15:12.837259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:12.837207 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" podUID="c5106856-9233-4bce-b2b3-f53b968de11a" containerName="registry" containerID="cri-o://c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2" gracePeriod=30 Jul 13 22:15:13.128269 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.128234 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:15:13.300466 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.300384 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-registry-certificates\") pod \"c5106856-9233-4bce-b2b3-f53b968de11a\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " Jul 13 22:15:13.300678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.300486 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7z68\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-kube-api-access-k7z68\") pod \"c5106856-9233-4bce-b2b3-f53b968de11a\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " Jul 13 22:15:13.300678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.300530 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5106856-9233-4bce-b2b3-f53b968de11a-ca-trust-extracted\") pod \"c5106856-9233-4bce-b2b3-f53b968de11a\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " Jul 13 22:15:13.300678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.300563 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-installation-pull-secrets\") pod \"c5106856-9233-4bce-b2b3-f53b968de11a\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " Jul 13 22:15:13.300678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.300590 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") pod \"c5106856-9233-4bce-b2b3-f53b968de11a\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " Jul 13 22:15:13.300678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.300640 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-bound-sa-token\") pod \"c5106856-9233-4bce-b2b3-f53b968de11a\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " Jul 13 22:15:13.300678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.300663 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-trusted-ca\") pod \"c5106856-9233-4bce-b2b3-f53b968de11a\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " Jul 13 22:15:13.300959 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.300787 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-image-registry-private-configuration\") pod \"c5106856-9233-4bce-b2b3-f53b968de11a\" (UID: \"c5106856-9233-4bce-b2b3-f53b968de11a\") " Jul 13 22:15:13.300959 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.300911 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c5106856-9233-4bce-b2b3-f53b968de11a" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:15:13.301089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.301062 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-registry-certificates\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:13.301342 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.301318 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c5106856-9233-4bce-b2b3-f53b968de11a" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:15:13.303200 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.303165 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c5106856-9233-4bce-b2b3-f53b968de11a" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:15:13.303302 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.303256 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c5106856-9233-4bce-b2b3-f53b968de11a" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:15:13.303302 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.303284 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-kube-api-access-k7z68" (OuterVolumeSpecName: "kube-api-access-k7z68") pod "c5106856-9233-4bce-b2b3-f53b968de11a" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a"). InnerVolumeSpecName "kube-api-access-k7z68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:15:13.303387 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.303290 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c5106856-9233-4bce-b2b3-f53b968de11a" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:15:13.303387 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.303351 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c5106856-9233-4bce-b2b3-f53b968de11a" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:15:13.309620 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.309590 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5106856-9233-4bce-b2b3-f53b968de11a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c5106856-9233-4bce-b2b3-f53b968de11a" (UID: "c5106856-9233-4bce-b2b3-f53b968de11a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:15:13.401607 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.401525 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7z68\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-kube-api-access-k7z68\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:13.401607 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.401554 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5106856-9233-4bce-b2b3-f53b968de11a-ca-trust-extracted\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:13.401607 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.401564 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-installation-pull-secrets\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:13.401607 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.401574 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-registry-tls\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:13.401607 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.401583 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5106856-9233-4bce-b2b3-f53b968de11a-bound-sa-token\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:13.401607 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.401592 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5106856-9233-4bce-b2b3-f53b968de11a-trusted-ca\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:13.401607 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.401600 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5106856-9233-4bce-b2b3-f53b968de11a-image-registry-private-configuration\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:13.426431 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.426353 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fc4d68859-cbl8g" podUID="d85866af-7e9d-4c2c-988e-bd6719022955" containerName="console" containerID="cri-o://1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670" gracePeriod=15 Jul 13 22:15:13.529185 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.529150 2581 generic.go:356] "Generic (PLEG): container finished" podID="c5106856-9233-4bce-b2b3-f53b968de11a" containerID="c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2" exitCode=0 Jul 13 22:15:13.529185 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.529195 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" Jul 13 22:15:13.529439 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.529230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" event={"ID":"c5106856-9233-4bce-b2b3-f53b968de11a","Type":"ContainerDied","Data":"c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2"} Jul 13 22:15:13.529439 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.529327 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77fdc59dd4-8pjvz" event={"ID":"c5106856-9233-4bce-b2b3-f53b968de11a","Type":"ContainerDied","Data":"272dbf46e4359c649fee895d4ea813d4caa906210a893ce3d13e56627b3517b6"} Jul 13 22:15:13.529439 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.529353 2581 scope.go:117] "RemoveContainer" containerID="c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2" Jul 13 22:15:13.538146 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.538121 2581 scope.go:117] "RemoveContainer" containerID="c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2" Jul 13 22:15:13.538499 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:15:13.538472 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2\": container with ID starting with c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2 not found: ID does not exist" containerID="c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2" Jul 13 22:15:13.538569 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.538507 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2"} err="failed to get container status \"c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2\": rpc error: code = NotFound desc = could not find container \"c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2\": container with ID starting with c0655d7a0eeaab902bd0469e6e46683d2f58aca5b14786c36c4b53d48c9fe5b2 not found: ID does not exist" Jul 13 22:15:13.559255 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.559220 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77fdc59dd4-8pjvz"] Jul 13 22:15:13.567315 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.567287 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77fdc59dd4-8pjvz"] Jul 13 22:15:13.726657 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.726624 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:15:13.905299 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.905268 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-oauth-config\") pod \"d85866af-7e9d-4c2c-988e-bd6719022955\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " Jul 13 22:15:13.905774 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.905322 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-serving-cert\") pod \"d85866af-7e9d-4c2c-988e-bd6719022955\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " Jul 13 22:15:13.905774 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.905360 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-oauth-serving-cert\") pod \"d85866af-7e9d-4c2c-988e-bd6719022955\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " Jul 13 22:15:13.905774 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.905396 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-console-config\") pod \"d85866af-7e9d-4c2c-988e-bd6719022955\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " Jul 13 22:15:13.905774 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.905431 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-service-ca\") pod \"d85866af-7e9d-4c2c-988e-bd6719022955\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " Jul 13 22:15:13.905774 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.905490 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbh78\" (UniqueName: \"kubernetes.io/projected/d85866af-7e9d-4c2c-988e-bd6719022955-kube-api-access-tbh78\") pod \"d85866af-7e9d-4c2c-988e-bd6719022955\" (UID: \"d85866af-7e9d-4c2c-988e-bd6719022955\") " Jul 13 22:15:13.906017 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.905861 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d85866af-7e9d-4c2c-988e-bd6719022955" (UID: "d85866af-7e9d-4c2c-988e-bd6719022955"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:15:13.906017 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.905877 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-console-config" (OuterVolumeSpecName: "console-config") pod "d85866af-7e9d-4c2c-988e-bd6719022955" (UID: "d85866af-7e9d-4c2c-988e-bd6719022955"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:15:13.906017 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.905882 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-service-ca" (OuterVolumeSpecName: "service-ca") pod "d85866af-7e9d-4c2c-988e-bd6719022955" (UID: "d85866af-7e9d-4c2c-988e-bd6719022955"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:15:13.906589 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.906565 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5106856-9233-4bce-b2b3-f53b968de11a" path="/var/lib/kubelet/pods/c5106856-9233-4bce-b2b3-f53b968de11a/volumes" Jul 13 22:15:13.907733 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.907711 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d85866af-7e9d-4c2c-988e-bd6719022955" (UID: "d85866af-7e9d-4c2c-988e-bd6719022955"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:15:13.907842 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.907789 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d85866af-7e9d-4c2c-988e-bd6719022955" (UID: "d85866af-7e9d-4c2c-988e-bd6719022955"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:15:13.907842 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:13.907814 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d85866af-7e9d-4c2c-988e-bd6719022955-kube-api-access-tbh78" (OuterVolumeSpecName: "kube-api-access-tbh78") pod "d85866af-7e9d-4c2c-988e-bd6719022955" (UID: "d85866af-7e9d-4c2c-988e-bd6719022955"). InnerVolumeSpecName "kube-api-access-tbh78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:15:14.006766 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.006730 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-console-config\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:14.006766 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.006764 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-service-ca\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:14.006949 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.006773 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbh78\" (UniqueName: \"kubernetes.io/projected/d85866af-7e9d-4c2c-988e-bd6719022955-kube-api-access-tbh78\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:14.006949 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.006781 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-oauth-config\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:14.006949 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.006794 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d85866af-7e9d-4c2c-988e-bd6719022955-console-serving-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:14.006949 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.006802 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d85866af-7e9d-4c2c-988e-bd6719022955-oauth-serving-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:14.534241 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.534204 2581 generic.go:356] "Generic (PLEG): container finished" podID="d85866af-7e9d-4c2c-988e-bd6719022955" containerID="1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670" exitCode=0 Jul 13 22:15:14.534459 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.534254 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc4d68859-cbl8g" Jul 13 22:15:14.534459 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.534292 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc4d68859-cbl8g" event={"ID":"d85866af-7e9d-4c2c-988e-bd6719022955","Type":"ContainerDied","Data":"1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670"} Jul 13 22:15:14.534459 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.534344 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc4d68859-cbl8g" event={"ID":"d85866af-7e9d-4c2c-988e-bd6719022955","Type":"ContainerDied","Data":"d213c453c0b2d2a6ee816a92fb612a05921c407f209af803523055e2dcb6d5ef"} Jul 13 22:15:14.534459 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.534371 2581 scope.go:117] "RemoveContainer" containerID="1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670" Jul 13 22:15:14.543050 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.543030 2581 scope.go:117] "RemoveContainer" containerID="1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670" Jul 13 22:15:14.543371 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:15:14.543351 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670\": container with ID starting with 1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670 not found: ID does not exist" containerID="1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670" Jul 13 22:15:14.543499 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.543383 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670"} err="failed to get container status \"1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670\": rpc error: code = NotFound desc = could not find container \"1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670\": container with ID starting with 1eea1d955f621b31ea9cabce04dc44a9684644655b67ba95562766b360426670 not found: ID does not exist" Jul 13 22:15:14.554802 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.554775 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc4d68859-cbl8g"] Jul 13 22:15:14.564342 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.564318 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fc4d68859-cbl8g"] Jul 13 22:15:14.866869 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.866782 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:14.920194 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:14.920150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:15.907112 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:15.907065 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d85866af-7e9d-4c2c-988e-bd6719022955" path="/var/lib/kubelet/pods/d85866af-7e9d-4c2c-988e-bd6719022955/volumes" Jul 13 22:15:21.822478 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:21.822439 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:21.928914 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:21.928885 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:21.985193 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:21.985153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:15:25.202853 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.202803 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d949b67b-4kgmr" podUID="7eab1f21-79f5-4784-a61c-d3e63e2b207b" containerName="console" containerID="cri-o://f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd" gracePeriod=15 Jul 13 22:15:25.482020 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.481960 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:15:25.493977 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.493954 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-oauth-serving-cert\") pod \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " Jul 13 22:15:25.494079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.493990 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-serving-cert\") pod \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " Jul 13 22:15:25.494079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.494020 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-service-ca\") pod \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " Jul 13 22:15:25.494079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.494047 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-trusted-ca-bundle\") pod \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " Jul 13 22:15:25.494189 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.494087 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-config\") pod \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " Jul 13 22:15:25.494189 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.494130 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-oauth-config\") pod \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " Jul 13 22:15:25.494189 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.494168 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwh7x\" (UniqueName: \"kubernetes.io/projected/7eab1f21-79f5-4784-a61c-d3e63e2b207b-kube-api-access-wwh7x\") pod \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\" (UID: \"7eab1f21-79f5-4784-a61c-d3e63e2b207b\") " Jul 13 22:15:25.494497 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.494461 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-service-ca" (OuterVolumeSpecName: "service-ca") pod "7eab1f21-79f5-4784-a61c-d3e63e2b207b" (UID: "7eab1f21-79f5-4784-a61c-d3e63e2b207b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:15:25.494497 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.494479 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-config" (OuterVolumeSpecName: "console-config") pod "7eab1f21-79f5-4784-a61c-d3e63e2b207b" (UID: "7eab1f21-79f5-4784-a61c-d3e63e2b207b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:15:25.494672 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.494504 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7eab1f21-79f5-4784-a61c-d3e63e2b207b" (UID: "7eab1f21-79f5-4784-a61c-d3e63e2b207b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:15:25.494672 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.494510 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7eab1f21-79f5-4784-a61c-d3e63e2b207b" (UID: "7eab1f21-79f5-4784-a61c-d3e63e2b207b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:15:25.496205 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.496183 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7eab1f21-79f5-4784-a61c-d3e63e2b207b" (UID: "7eab1f21-79f5-4784-a61c-d3e63e2b207b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:15:25.496273 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.496231 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eab1f21-79f5-4784-a61c-d3e63e2b207b-kube-api-access-wwh7x" (OuterVolumeSpecName: "kube-api-access-wwh7x") pod "7eab1f21-79f5-4784-a61c-d3e63e2b207b" (UID: "7eab1f21-79f5-4784-a61c-d3e63e2b207b"). InnerVolumeSpecName "kube-api-access-wwh7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:15:25.496273 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.496231 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7eab1f21-79f5-4784-a61c-d3e63e2b207b" (UID: "7eab1f21-79f5-4784-a61c-d3e63e2b207b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:15:25.578347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.578315 2581 generic.go:356] "Generic (PLEG): container finished" podID="7eab1f21-79f5-4784-a61c-d3e63e2b207b" containerID="f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd" exitCode=0 Jul 13 22:15:25.578465 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.578354 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d949b67b-4kgmr" event={"ID":"7eab1f21-79f5-4784-a61c-d3e63e2b207b","Type":"ContainerDied","Data":"f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd"} Jul 13 22:15:25.578465 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.578395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d949b67b-4kgmr" event={"ID":"7eab1f21-79f5-4784-a61c-d3e63e2b207b","Type":"ContainerDied","Data":"8685d180929f472728e1e64385c4d9e2218c7ce726a9fe08189e5f53d4f66fbc"} Jul 13 22:15:25.578465 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.578415 2581 scope.go:117] "RemoveContainer" containerID="f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd" Jul 13 22:15:25.578465 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.578357 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d949b67b-4kgmr" Jul 13 22:15:25.586822 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.586800 2581 scope.go:117] "RemoveContainer" containerID="f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd" Jul 13 22:15:25.587066 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:15:25.587050 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd\": container with ID starting with f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd not found: ID does not exist" containerID="f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd" Jul 13 22:15:25.587118 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.587073 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd"} err="failed to get container status \"f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd\": rpc error: code = NotFound desc = could not find container \"f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd\": container with ID starting with f6fe29621c868488677fae763d4e4d8e363493673cd2834c75c141830ed1f2cd not found: ID does not exist" Jul 13 22:15:25.594847 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.594830 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-oauth-serving-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:25.594904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.594850 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-serving-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:25.594904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.594861 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-service-ca\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:25.594904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.594869 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-trusted-ca-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:25.594904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.594877 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-config\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:25.594904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.594896 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7eab1f21-79f5-4784-a61c-d3e63e2b207b-console-oauth-config\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:25.595050 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.594905 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwh7x\" (UniqueName: \"kubernetes.io/projected/7eab1f21-79f5-4784-a61c-d3e63e2b207b-kube-api-access-wwh7x\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:15:25.597278 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.597256 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d949b67b-4kgmr"] Jul 13 22:15:25.601587 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.601569 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d949b67b-4kgmr"] Jul 13 22:15:25.910086 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:15:25.910044 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eab1f21-79f5-4784-a61c-d3e63e2b207b" path="/var/lib/kubelet/pods/7eab1f21-79f5-4784-a61c-d3e63e2b207b/volumes" Jul 13 22:16:03.757592 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:03.757558 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:03.861886 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:03.861851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:13.251694 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.251661 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-794967f466-wt4hn"] Jul 13 22:16:13.252160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.251963 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eab1f21-79f5-4784-a61c-d3e63e2b207b" containerName="console" Jul 13 22:16:13.252160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.251974 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eab1f21-79f5-4784-a61c-d3e63e2b207b" containerName="console" Jul 13 22:16:13.252160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.251986 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5106856-9233-4bce-b2b3-f53b968de11a" containerName="registry" Jul 13 22:16:13.252160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.251992 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5106856-9233-4bce-b2b3-f53b968de11a" containerName="registry" Jul 13 22:16:13.252160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.252004 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d85866af-7e9d-4c2c-988e-bd6719022955" containerName="console" Jul 13 22:16:13.252160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.252009 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d85866af-7e9d-4c2c-988e-bd6719022955" containerName="console" Jul 13 22:16:13.252160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.252066 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eab1f21-79f5-4784-a61c-d3e63e2b207b" containerName="console" Jul 13 22:16:13.252160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.252077 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5106856-9233-4bce-b2b3-f53b968de11a" containerName="registry" Jul 13 22:16:13.252160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.252084 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d85866af-7e9d-4c2c-988e-bd6719022955" containerName="console" Jul 13 22:16:13.254021 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.254000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.256299 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:16:13.256156 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"oauth-serving-cert\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" type="*v1.ConfigMap" Jul 13 22:16:13.256299 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:16:13.256269 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-oauth-config\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"console-oauth-config\"" type="*v1.Secret" Jul 13 22:16:13.262437 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.262401 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 22:16:13.262556 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.262494 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lvv74\"" Jul 13 22:16:13.262556 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.262516 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 22:16:13.262678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.262588 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 22:16:13.262936 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.262919 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 22:16:13.286305 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.286271 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794967f466-wt4hn"] Jul 13 22:16:13.331978 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.331941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-oauth-serving-cert\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.331978 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.331979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8zz\" (UniqueName: \"kubernetes.io/projected/928797e8-a256-4ec3-a3ef-959053333624-kube-api-access-vr8zz\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.332187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.332008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-serving-cert\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.332187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.332077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-oauth-config\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.332187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.332135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-console-config\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.332187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.332173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-service-ca\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.332312 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.332209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-trusted-ca-bundle\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.335566 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.335532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:13.416376 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.416332 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:13.433077 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.433038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-oauth-serving-cert\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.433077 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.433076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8zz\" (UniqueName: \"kubernetes.io/projected/928797e8-a256-4ec3-a3ef-959053333624-kube-api-access-vr8zz\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.433287 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.433116 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-serving-cert\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.433287 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.433148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-oauth-config\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.433287 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.433191 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-console-config\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.433287 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.433222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-service-ca\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.433287 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.433280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-trusted-ca-bundle\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.433901 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.433879 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-console-config\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.433994 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.433916 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-service-ca\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.434103 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.434082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-trusted-ca-bundle\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.435796 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.435775 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-serving-cert\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:13.441429 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:13.441389 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8zz\" (UniqueName: \"kubernetes.io/projected/928797e8-a256-4ec3-a3ef-959053333624-kube-api-access-vr8zz\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:14.433672 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:16:14.433633 2581 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: failed to sync configmap cache: timed out waiting for the condition Jul 13 22:16:14.434069 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:16:14.433727 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-oauth-serving-cert podName:928797e8-a256-4ec3-a3ef-959053333624 nodeName:}" failed. No retries permitted until 2026-07-13 22:16:14.933708185 +0000 UTC m=+179.536984389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-oauth-serving-cert") pod "console-794967f466-wt4hn" (UID: "928797e8-a256-4ec3-a3ef-959053333624") : failed to sync configmap cache: timed out waiting for the condition Jul 13 22:16:14.434069 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:16:14.433633 2581 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: failed to sync secret cache: timed out waiting for the condition Jul 13 22:16:14.434069 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:16:14.433783 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-oauth-config podName:928797e8-a256-4ec3-a3ef-959053333624 nodeName:}" failed. No retries permitted until 2026-07-13 22:16:14.933771345 +0000 UTC m=+179.537047556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-oauth-config") pod "console-794967f466-wt4hn" (UID: "928797e8-a256-4ec3-a3ef-959053333624") : failed to sync secret cache: timed out waiting for the condition Jul 13 22:16:14.610069 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:14.610031 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 22:16:14.748432 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:14.748329 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 22:16:14.947308 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:14.947271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-oauth-serving-cert\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:14.947497 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:14.947329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-oauth-config\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:14.948014 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:14.947993 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-oauth-serving-cert\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:14.949720 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:14.949695 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-oauth-config\") pod \"console-794967f466-wt4hn\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:15.064044 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:15.064000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:15.194632 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:15.194591 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794967f466-wt4hn"] Jul 13 22:16:15.198315 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:16:15.198290 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod928797e8_a256_4ec3_a3ef_959053333624.slice/crio-039a50825b7586b69f4a381d6f2326b2609c72c99755c7d58aef5d4314d74aea WatchSource:0}: Error finding container 039a50825b7586b69f4a381d6f2326b2609c72c99755c7d58aef5d4314d74aea: Status 404 returned error can't find the container with id 039a50825b7586b69f4a381d6f2326b2609c72c99755c7d58aef5d4314d74aea Jul 13 22:16:15.765903 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:15.765860 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794967f466-wt4hn" event={"ID":"928797e8-a256-4ec3-a3ef-959053333624","Type":"ContainerStarted","Data":"16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b"} Jul 13 22:16:15.766290 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:15.765953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794967f466-wt4hn" event={"ID":"928797e8-a256-4ec3-a3ef-959053333624","Type":"ContainerStarted","Data":"039a50825b7586b69f4a381d6f2326b2609c72c99755c7d58aef5d4314d74aea"} Jul 13 22:16:15.783646 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:15.783579 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-794967f466-wt4hn" podStartSLOduration=2.783560302 podStartE2EDuration="2.783560302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:16:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:16:15.782671898 +0000 UTC m=+180.385948125" watchObservedRunningTime="2026-07-13 22:16:15.783560302 +0000 UTC m=+180.386836532" Jul 13 22:16:19.030335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.030295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:19.087203 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.087174 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:19.860346 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.859215 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794967f466-wt4hn"] Jul 13 22:16:19.886817 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.886785 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c8fb66746-42r9d"] Jul 13 22:16:19.890007 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.889987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:19.913237 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.913208 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8fb66746-42r9d"] Jul 13 22:16:19.992439 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.992395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-config\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:19.992601 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.992512 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-trusted-ca-bundle\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:19.992601 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.992566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-oauth-config\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:19.992673 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.992604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-serving-cert\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:19.992673 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.992633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-oauth-serving-cert\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:19.992738 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.992674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgnpj\" (UniqueName: \"kubernetes.io/projected/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-kube-api-access-dgnpj\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:19.992738 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:19.992691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-service-ca\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.093230 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.093189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-serving-cert\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.093230 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.093237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-oauth-serving-cert\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.093807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.093265 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgnpj\" (UniqueName: \"kubernetes.io/projected/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-kube-api-access-dgnpj\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.093807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.093282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-service-ca\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.093807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.093320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-config\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.093807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.093369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-trusted-ca-bundle\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.093807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.093401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-oauth-config\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.094233 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.094203 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-config\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.094366 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.094344 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-service-ca\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.094457 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.094416 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-oauth-serving-cert\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.094845 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.094823 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-trusted-ca-bundle\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.095860 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.095839 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-serving-cert\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.095970 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.095955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-oauth-config\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.100810 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.100788 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgnpj\" (UniqueName: \"kubernetes.io/projected/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-kube-api-access-dgnpj\") pod \"console-7c8fb66746-42r9d\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.198743 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.198653 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:20.253548 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.253076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:20.335902 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.335870 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8fb66746-42r9d"] Jul 13 22:16:20.338659 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.338602 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:20.339102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:16:20.339069 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb149fe_44da_4e4e_88a2_d3e2bde0be61.slice/crio-0af5194bfe0368ecb4818183a8af2bbe150d7e2b9ced7af19e2c29a5592fba00 WatchSource:0}: Error finding container 0af5194bfe0368ecb4818183a8af2bbe150d7e2b9ced7af19e2c29a5592fba00: Status 404 returned error can't find the container with id 0af5194bfe0368ecb4818183a8af2bbe150d7e2b9ced7af19e2c29a5592fba00 Jul 13 22:16:20.786098 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.786065 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8fb66746-42r9d" event={"ID":"2cb149fe-44da-4e4e-88a2-d3e2bde0be61","Type":"ContainerStarted","Data":"4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe"} Jul 13 22:16:20.786284 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.786117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8fb66746-42r9d" event={"ID":"2cb149fe-44da-4e4e-88a2-d3e2bde0be61","Type":"ContainerStarted","Data":"0af5194bfe0368ecb4818183a8af2bbe150d7e2b9ced7af19e2c29a5592fba00"} Jul 13 22:16:20.803755 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.803696 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c8fb66746-42r9d" podStartSLOduration=1.803679826 podStartE2EDuration="1.803679826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:16:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:16:20.802155619 +0000 UTC m=+185.405431849" watchObservedRunningTime="2026-07-13 22:16:20.803679826 +0000 UTC m=+185.406956052" Jul 13 22:16:20.849332 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.849300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:20.910259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:20.910220 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:25.064380 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:25.064344 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:30.199237 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:30.199203 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:30.199802 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:30.199257 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:30.204527 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:30.204494 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:30.829148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:30.829120 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:16:30.996773 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:30.996721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:31.098772 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:31.098686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:31.158224 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:31.158190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:32.794980 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:32.794948 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:42.612343 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:42.612304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:44.868928 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:44.868896 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:44.881778 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:44.881751 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-794967f466-wt4hn" podUID="928797e8-a256-4ec3-a3ef-959053333624" containerName="console" containerID="cri-o://16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b" gracePeriod=15 Jul 13 22:16:44.973193 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:44.973159 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:45.036083 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.036056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:16:45.119406 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.119351 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:45.291568 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.291543 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-serving-cert\") pod \"928797e8-a256-4ec3-a3ef-959053333624\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " Jul 13 22:16:45.291722 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.291577 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-trusted-ca-bundle\") pod \"928797e8-a256-4ec3-a3ef-959053333624\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " Jul 13 22:16:45.291722 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.291603 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr8zz\" (UniqueName: \"kubernetes.io/projected/928797e8-a256-4ec3-a3ef-959053333624-kube-api-access-vr8zz\") pod \"928797e8-a256-4ec3-a3ef-959053333624\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " Jul 13 22:16:45.291722 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.291624 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-service-ca\") pod \"928797e8-a256-4ec3-a3ef-959053333624\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " Jul 13 22:16:45.291722 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.291670 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-console-config\") pod \"928797e8-a256-4ec3-a3ef-959053333624\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " Jul 13 22:16:45.291722 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.291706 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-oauth-config\") pod \"928797e8-a256-4ec3-a3ef-959053333624\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " Jul 13 22:16:45.291975 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.291756 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-oauth-serving-cert\") pod \"928797e8-a256-4ec3-a3ef-959053333624\" (UID: \"928797e8-a256-4ec3-a3ef-959053333624\") " Jul 13 22:16:45.292206 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.292175 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "928797e8-a256-4ec3-a3ef-959053333624" (UID: "928797e8-a256-4ec3-a3ef-959053333624"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:16:45.292206 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.292182 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-console-config" (OuterVolumeSpecName: "console-config") pod "928797e8-a256-4ec3-a3ef-959053333624" (UID: "928797e8-a256-4ec3-a3ef-959053333624"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:16:45.292381 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.292193 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-service-ca" (OuterVolumeSpecName: "service-ca") pod "928797e8-a256-4ec3-a3ef-959053333624" (UID: "928797e8-a256-4ec3-a3ef-959053333624"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:16:45.292381 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.292226 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "928797e8-a256-4ec3-a3ef-959053333624" (UID: "928797e8-a256-4ec3-a3ef-959053333624"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:16:45.293682 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.293657 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "928797e8-a256-4ec3-a3ef-959053333624" (UID: "928797e8-a256-4ec3-a3ef-959053333624"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:16:45.293862 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.293840 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "928797e8-a256-4ec3-a3ef-959053333624" (UID: "928797e8-a256-4ec3-a3ef-959053333624"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:16:45.293907 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.293889 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/928797e8-a256-4ec3-a3ef-959053333624-kube-api-access-vr8zz" (OuterVolumeSpecName: "kube-api-access-vr8zz") pod "928797e8-a256-4ec3-a3ef-959053333624" (UID: "928797e8-a256-4ec3-a3ef-959053333624"). InnerVolumeSpecName "kube-api-access-vr8zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:16:45.393070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.393014 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-oauth-config\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:16:45.393070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.393037 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-oauth-serving-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:16:45.393070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.393048 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/928797e8-a256-4ec3-a3ef-959053333624-console-serving-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:16:45.393070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.393056 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-trusted-ca-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:16:45.393070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.393065 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr8zz\" (UniqueName: \"kubernetes.io/projected/928797e8-a256-4ec3-a3ef-959053333624-kube-api-access-vr8zz\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:16:45.393281 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.393075 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-service-ca\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:16:45.393281 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.393085 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/928797e8-a256-4ec3-a3ef-959053333624-console-config\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:16:45.883084 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.883052 2581 generic.go:356] "Generic (PLEG): container finished" podID="928797e8-a256-4ec3-a3ef-959053333624" containerID="16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b" exitCode=0 Jul 13 22:16:45.883508 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.883100 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794967f466-wt4hn" Jul 13 22:16:45.883508 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.883114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794967f466-wt4hn" event={"ID":"928797e8-a256-4ec3-a3ef-959053333624","Type":"ContainerDied","Data":"16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b"} Jul 13 22:16:45.883508 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.883153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794967f466-wt4hn" event={"ID":"928797e8-a256-4ec3-a3ef-959053333624","Type":"ContainerDied","Data":"039a50825b7586b69f4a381d6f2326b2609c72c99755c7d58aef5d4314d74aea"} Jul 13 22:16:45.883508 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.883178 2581 scope.go:117] "RemoveContainer" containerID="16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b" Jul 13 22:16:45.893974 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.893950 2581 scope.go:117] "RemoveContainer" containerID="16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b" Jul 13 22:16:45.894331 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:16:45.894303 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b\": container with ID starting with 16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b not found: ID does not exist" containerID="16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b" Jul 13 22:16:45.894903 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.894376 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b"} err="failed to get container status \"16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b\": rpc error: code = NotFound desc = could not find container \"16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b\": container with ID starting with 16e1d17d6074cb7779a21d8902b14beff189c85b045b11622b07f9ea71a7839b not found: ID does not exist" Jul 13 22:16:45.906218 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.906195 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794967f466-wt4hn"] Jul 13 22:16:45.910304 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:45.910282 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-794967f466-wt4hn"] Jul 13 22:16:47.905433 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:16:47.905377 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="928797e8-a256-4ec3-a3ef-959053333624" path="/var/lib/kubelet/pods/928797e8-a256-4ec3-a3ef-959053333624/volumes" Jul 13 22:17:20.198296 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.198259 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:20.344227 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.344186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:20.926004 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.925971 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr"] Jul 13 22:17:20.926271 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.926259 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="928797e8-a256-4ec3-a3ef-959053333624" containerName="console" Jul 13 22:17:20.926314 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.926274 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="928797e8-a256-4ec3-a3ef-959053333624" containerName="console" Jul 13 22:17:20.926353 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.926343 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="928797e8-a256-4ec3-a3ef-959053333624" containerName="console" Jul 13 22:17:20.929095 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.929079 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:20.931163 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.931142 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 22:17:20.931754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.931741 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sqrgv\"" Jul 13 22:17:20.931803 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.931745 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 22:17:20.937044 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.937024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr"] Jul 13 22:17:20.960272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.960253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:20.960408 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.960292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:20.960408 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:20.960315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdv5k\" (UniqueName: \"kubernetes.io/projected/26e7d93c-edfa-450d-a054-ee532fa9e47f-kube-api-access-wdv5k\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:21.060985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:21.060965 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:21.061086 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:21.060991 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdv5k\" (UniqueName: \"kubernetes.io/projected/26e7d93c-edfa-450d-a054-ee532fa9e47f-kube-api-access-wdv5k\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:21.061086 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:21.061044 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:21.061312 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:21.061297 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:21.061348 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:21.061326 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:21.069125 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:21.069100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdv5k\" (UniqueName: \"kubernetes.io/projected/26e7d93c-edfa-450d-a054-ee532fa9e47f-kube-api-access-wdv5k\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:21.238654 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:21.238578 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:21.364175 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:21.364154 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr"] Jul 13 22:17:21.365859 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:17:21.365833 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e7d93c_edfa_450d_a054_ee532fa9e47f.slice/crio-57059432221b59c589a42b0e2fbbb0e90d4647407e5d26b03e09bf9ea2703863 WatchSource:0}: Error finding container 57059432221b59c589a42b0e2fbbb0e90d4647407e5d26b03e09bf9ea2703863: Status 404 returned error can't find the container with id 57059432221b59c589a42b0e2fbbb0e90d4647407e5d26b03e09bf9ea2703863 Jul 13 22:17:22.013533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:22.013494 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" event={"ID":"26e7d93c-edfa-450d-a054-ee532fa9e47f","Type":"ContainerStarted","Data":"57059432221b59c589a42b0e2fbbb0e90d4647407e5d26b03e09bf9ea2703863"} Jul 13 22:17:23.328469 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:23.328436 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:29.043510 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:29.043477 2581 generic.go:356] "Generic (PLEG): container finished" podID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerID="630567b7f91b34b7ffeb12c919821b33ae9e1a88968b5f241af0a6d42eea7b87" exitCode=0 Jul 13 22:17:29.043875 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:29.043543 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" event={"ID":"26e7d93c-edfa-450d-a054-ee532fa9e47f","Type":"ContainerDied","Data":"630567b7f91b34b7ffeb12c919821b33ae9e1a88968b5f241af0a6d42eea7b87"} Jul 13 22:17:32.057315 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:32.057282 2581 generic.go:356] "Generic (PLEG): container finished" podID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerID="5242f77804aedde7c761e48ca70ee0ddf7cf18afa72b15bb1f5f5d3f89b73d82" exitCode=0 Jul 13 22:17:32.057742 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:32.057338 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" event={"ID":"26e7d93c-edfa-450d-a054-ee532fa9e47f","Type":"ContainerDied","Data":"5242f77804aedde7c761e48ca70ee0ddf7cf18afa72b15bb1f5f5d3f89b73d82"} Jul 13 22:17:41.094027 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:41.093957 2581 generic.go:356] "Generic (PLEG): container finished" podID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerID="bb9a00c956e1ffa16e3711ac8e92aea952614ea0f36baad836d6dfe3f538b118" exitCode=0 Jul 13 22:17:41.094347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:41.094039 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" event={"ID":"26e7d93c-edfa-450d-a054-ee532fa9e47f","Type":"ContainerDied","Data":"bb9a00c956e1ffa16e3711ac8e92aea952614ea0f36baad836d6dfe3f538b118"} Jul 13 22:17:42.224450 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.224410 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:42.327989 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.327962 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-util\") pod \"26e7d93c-edfa-450d-a054-ee532fa9e47f\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " Jul 13 22:17:42.328141 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.328020 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdv5k\" (UniqueName: \"kubernetes.io/projected/26e7d93c-edfa-450d-a054-ee532fa9e47f-kube-api-access-wdv5k\") pod \"26e7d93c-edfa-450d-a054-ee532fa9e47f\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " Jul 13 22:17:42.328141 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.328067 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-bundle\") pod \"26e7d93c-edfa-450d-a054-ee532fa9e47f\" (UID: \"26e7d93c-edfa-450d-a054-ee532fa9e47f\") " Jul 13 22:17:42.328738 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.328714 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-bundle" (OuterVolumeSpecName: "bundle") pod "26e7d93c-edfa-450d-a054-ee532fa9e47f" (UID: "26e7d93c-edfa-450d-a054-ee532fa9e47f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:17:42.330208 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.330179 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26e7d93c-edfa-450d-a054-ee532fa9e47f-kube-api-access-wdv5k" (OuterVolumeSpecName: "kube-api-access-wdv5k") pod "26e7d93c-edfa-450d-a054-ee532fa9e47f" (UID: "26e7d93c-edfa-450d-a054-ee532fa9e47f"). InnerVolumeSpecName "kube-api-access-wdv5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:17:42.332811 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.332791 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-util" (OuterVolumeSpecName: "util") pod "26e7d93c-edfa-450d-a054-ee532fa9e47f" (UID: "26e7d93c-edfa-450d-a054-ee532fa9e47f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:17:42.428507 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.428451 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:17:42.428507 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.428475 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e7d93c-edfa-450d-a054-ee532fa9e47f-util\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:17:42.428507 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:42.428484 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdv5k\" (UniqueName: \"kubernetes.io/projected/26e7d93c-edfa-450d-a054-ee532fa9e47f-kube-api-access-wdv5k\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:17:43.103222 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:43.103196 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" Jul 13 22:17:43.103374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:43.103195 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540tjvzr" event={"ID":"26e7d93c-edfa-450d-a054-ee532fa9e47f","Type":"ContainerDied","Data":"57059432221b59c589a42b0e2fbbb0e90d4647407e5d26b03e09bf9ea2703863"} Jul 13 22:17:43.103374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:43.103310 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57059432221b59c589a42b0e2fbbb0e90d4647407e5d26b03e09bf9ea2703863" Jul 13 22:17:47.249056 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:47.249019 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:48.679012 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:48.678977 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:49.176372 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.176337 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj"] Jul 13 22:17:49.176668 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.176655 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerName="util" Jul 13 22:17:49.176715 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.176670 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerName="util" Jul 13 22:17:49.176715 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.176695 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerName="extract" Jul 13 22:17:49.176715 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.176701 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerName="extract" Jul 13 22:17:49.176715 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.176709 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerName="pull" Jul 13 22:17:49.176715 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.176714 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerName="pull" Jul 13 22:17:49.176867 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.176761 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="26e7d93c-edfa-450d-a054-ee532fa9e47f" containerName="extract" Jul 13 22:17:49.179683 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.179666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" Jul 13 22:17:49.182648 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.182624 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 22:17:49.182771 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.182711 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xbpq4\"" Jul 13 22:17:49.182935 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.182912 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 22:17:49.193153 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.193129 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj"] Jul 13 22:17:49.283696 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.283665 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctcz2\" (UniqueName: \"kubernetes.io/projected/47964345-e77c-47af-b588-0dc4d38df3d4-kube-api-access-ctcz2\") pod \"cert-manager-operator-controller-manager-55c444bf86-nz6zj\" (UID: \"47964345-e77c-47af-b588-0dc4d38df3d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" Jul 13 22:17:49.283847 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.283716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47964345-e77c-47af-b588-0dc4d38df3d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nz6zj\" (UID: \"47964345-e77c-47af-b588-0dc4d38df3d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" Jul 13 22:17:49.384782 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.384757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47964345-e77c-47af-b588-0dc4d38df3d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nz6zj\" (UID: \"47964345-e77c-47af-b588-0dc4d38df3d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" Jul 13 22:17:49.384922 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.384812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctcz2\" (UniqueName: \"kubernetes.io/projected/47964345-e77c-47af-b588-0dc4d38df3d4-kube-api-access-ctcz2\") pod \"cert-manager-operator-controller-manager-55c444bf86-nz6zj\" (UID: \"47964345-e77c-47af-b588-0dc4d38df3d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" Jul 13 22:17:49.385141 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.385123 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47964345-e77c-47af-b588-0dc4d38df3d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nz6zj\" (UID: \"47964345-e77c-47af-b588-0dc4d38df3d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" Jul 13 22:17:49.392475 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.392452 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctcz2\" (UniqueName: \"kubernetes.io/projected/47964345-e77c-47af-b588-0dc4d38df3d4-kube-api-access-ctcz2\") pod \"cert-manager-operator-controller-manager-55c444bf86-nz6zj\" (UID: \"47964345-e77c-47af-b588-0dc4d38df3d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" Jul 13 22:17:49.488052 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.487994 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" Jul 13 22:17:49.610287 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:49.610265 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj"] Jul 13 22:17:49.612672 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:17:49.612642 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47964345_e77c_47af_b588_0dc4d38df3d4.slice/crio-b5925993893321371e7b958fcd3f03bd5b4596b977af524e7f74078e60c787e0 WatchSource:0}: Error finding container b5925993893321371e7b958fcd3f03bd5b4596b977af524e7f74078e60c787e0: Status 404 returned error can't find the container with id b5925993893321371e7b958fcd3f03bd5b4596b977af524e7f74078e60c787e0 Jul 13 22:17:50.133124 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:50.133085 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" event={"ID":"47964345-e77c-47af-b588-0dc4d38df3d4","Type":"ContainerStarted","Data":"b5925993893321371e7b958fcd3f03bd5b4596b977af524e7f74078e60c787e0"} Jul 13 22:17:50.851899 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:50.851860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:50.955696 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:50.955656 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:51.139973 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:51.139886 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" event={"ID":"47964345-e77c-47af-b588-0dc4d38df3d4","Type":"ContainerStarted","Data":"774acd2b50b9003b9169f717d58f0fb13659ae010549de2a832af653ad3a4a55"} Jul 13 22:17:51.158999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:51.158939 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nz6zj" podStartSLOduration=0.758736573 podStartE2EDuration="2.158922019s" totalImagesPullingTime="1.400185446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:17:51.15729011 +0000 UTC m=+275.760566338" watchObservedRunningTime="2026-07-13 22:17:51.158922019 +0000 UTC m=+275.762198246" Jul 13 22:17:51.502109 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:51.502075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:51.610562 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:51.610521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:52.470401 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.470367 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7"] Jul 13 22:17:52.472635 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.472616 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.474829 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.474809 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 22:17:52.475375 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.475360 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sqrgv\"" Jul 13 22:17:52.475477 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.475383 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 22:17:52.481351 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.481332 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7"] Jul 13 22:17:52.610623 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.610594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.610763 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.610627 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.610763 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.610646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jbq9\" (UniqueName: \"kubernetes.io/projected/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-kube-api-access-7jbq9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.711199 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.711173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.711332 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.711209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.711332 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.711235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jbq9\" (UniqueName: \"kubernetes.io/projected/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-kube-api-access-7jbq9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.711581 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.711560 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.711656 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.711620 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.725842 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.725791 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jbq9\" (UniqueName: \"kubernetes.io/projected/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-kube-api-access-7jbq9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.759453 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.759412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:52.781505 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.781481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:52.872395 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.872361 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:52.912322 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:52.912298 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7"] Jul 13 22:17:52.914115 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:17:52.914089 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0a4479_80f8_40f8_a141_3f9d35f5ea98.slice/crio-8fc6ed64349c5ed29344d63851595ad364d8a39463786c2a9146293319cc10ae WatchSource:0}: Error finding container 8fc6ed64349c5ed29344d63851595ad364d8a39463786c2a9146293319cc10ae: Status 404 returned error can't find the container with id 8fc6ed64349c5ed29344d63851595ad364d8a39463786c2a9146293319cc10ae Jul 13 22:17:53.149833 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:53.149797 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerID="29916bac09f57470304475f276e8d7f47c5e2bf1e2860fbb98832ddf94549aa0" exitCode=0 Jul 13 22:17:53.150013 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:53.149886 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" event={"ID":"6e0a4479-80f8-40f8-a141-3f9d35f5ea98","Type":"ContainerDied","Data":"29916bac09f57470304475f276e8d7f47c5e2bf1e2860fbb98832ddf94549aa0"} Jul 13 22:17:53.150013 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:53.149937 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" event={"ID":"6e0a4479-80f8-40f8-a141-3f9d35f5ea98","Type":"ContainerStarted","Data":"8fc6ed64349c5ed29344d63851595ad364d8a39463786c2a9146293319cc10ae"} Jul 13 22:17:54.567115 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:54.567078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:55.152153 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.152109 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:55.161330 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.161288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" event={"ID":"6e0a4479-80f8-40f8-a141-3f9d35f5ea98","Type":"ContainerStarted","Data":"78cec80056f2ad63c74a9fb7fcc9d5c9dbdc925d937ce2e59f6ddc09c2a469ae"} Jul 13 22:17:55.509433 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.509389 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b"] Jul 13 22:17:55.512489 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.512473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" Jul 13 22:17:55.514725 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.514704 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cb7qk\"" Jul 13 22:17:55.514838 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.514706 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 22:17:55.514888 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.514854 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 22:17:55.524981 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.524953 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b"] Jul 13 22:17:55.635000 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.634974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e8a326c-5b31-42d7-a1a0-8660a1333773-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pnl9b\" (UID: \"1e8a326c-5b31-42d7-a1a0-8660a1333773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" Jul 13 22:17:55.635332 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.635038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thhmg\" (UniqueName: \"kubernetes.io/projected/1e8a326c-5b31-42d7-a1a0-8660a1333773-kube-api-access-thhmg\") pod \"cert-manager-cainjector-559cdd8c87-pnl9b\" (UID: \"1e8a326c-5b31-42d7-a1a0-8660a1333773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" Jul 13 22:17:55.735497 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.735465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thhmg\" (UniqueName: \"kubernetes.io/projected/1e8a326c-5b31-42d7-a1a0-8660a1333773-kube-api-access-thhmg\") pod \"cert-manager-cainjector-559cdd8c87-pnl9b\" (UID: \"1e8a326c-5b31-42d7-a1a0-8660a1333773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" Jul 13 22:17:55.735640 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.735535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e8a326c-5b31-42d7-a1a0-8660a1333773-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pnl9b\" (UID: \"1e8a326c-5b31-42d7-a1a0-8660a1333773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" Jul 13 22:17:55.743498 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.743470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e8a326c-5b31-42d7-a1a0-8660a1333773-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pnl9b\" (UID: \"1e8a326c-5b31-42d7-a1a0-8660a1333773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" Jul 13 22:17:55.743612 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.743595 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thhmg\" (UniqueName: \"kubernetes.io/projected/1e8a326c-5b31-42d7-a1a0-8660a1333773-kube-api-access-thhmg\") pod \"cert-manager-cainjector-559cdd8c87-pnl9b\" (UID: \"1e8a326c-5b31-42d7-a1a0-8660a1333773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" Jul 13 22:17:55.828217 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.828139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" Jul 13 22:17:55.960131 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:55.959983 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b"] Jul 13 22:17:55.962137 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:17:55.962109 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e8a326c_5b31_42d7_a1a0_8660a1333773.slice/crio-4e4fdbe9469082f7e215ea3a733e1527cb6895885af69ae9653f081294da8151 WatchSource:0}: Error finding container 4e4fdbe9469082f7e215ea3a733e1527cb6895885af69ae9653f081294da8151: Status 404 returned error can't find the container with id 4e4fdbe9469082f7e215ea3a733e1527cb6895885af69ae9653f081294da8151 Jul 13 22:17:56.166313 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:56.166228 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" event={"ID":"1e8a326c-5b31-42d7-a1a0-8660a1333773","Type":"ContainerStarted","Data":"4e4fdbe9469082f7e215ea3a733e1527cb6895885af69ae9653f081294da8151"} Jul 13 22:17:56.168031 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:56.168004 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerID="78cec80056f2ad63c74a9fb7fcc9d5c9dbdc925d937ce2e59f6ddc09c2a469ae" exitCode=0 Jul 13 22:17:56.168118 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:56.168048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" event={"ID":"6e0a4479-80f8-40f8-a141-3f9d35f5ea98","Type":"ContainerDied","Data":"78cec80056f2ad63c74a9fb7fcc9d5c9dbdc925d937ce2e59f6ddc09c2a469ae"} Jul 13 22:17:57.175003 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:57.174966 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerID="fcf8e73c9915c83cf3d68ab82d851a3f0257156d51eeedcdcaa19ff00920569a" exitCode=0 Jul 13 22:17:57.175397 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:57.175064 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" event={"ID":"6e0a4479-80f8-40f8-a141-3f9d35f5ea98","Type":"ContainerDied","Data":"fcf8e73c9915c83cf3d68ab82d851a3f0257156d51eeedcdcaa19ff00920569a"} Jul 13 22:17:58.048352 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.048313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:58.151361 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.151312 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:58.558168 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.558143 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:58.658251 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.658230 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-bundle\") pod \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " Jul 13 22:17:58.658344 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.658266 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jbq9\" (UniqueName: \"kubernetes.io/projected/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-kube-api-access-7jbq9\") pod \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " Jul 13 22:17:58.658344 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.658341 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-util\") pod \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\" (UID: \"6e0a4479-80f8-40f8-a141-3f9d35f5ea98\") " Jul 13 22:17:58.658692 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.658668 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-bundle" (OuterVolumeSpecName: "bundle") pod "6e0a4479-80f8-40f8-a141-3f9d35f5ea98" (UID: "6e0a4479-80f8-40f8-a141-3f9d35f5ea98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:17:58.660245 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.660223 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-kube-api-access-7jbq9" (OuterVolumeSpecName: "kube-api-access-7jbq9") pod "6e0a4479-80f8-40f8-a141-3f9d35f5ea98" (UID: "6e0a4479-80f8-40f8-a141-3f9d35f5ea98"). InnerVolumeSpecName "kube-api-access-7jbq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:17:58.662953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.662929 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-util" (OuterVolumeSpecName: "util") pod "6e0a4479-80f8-40f8-a141-3f9d35f5ea98" (UID: "6e0a4479-80f8-40f8-a141-3f9d35f5ea98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:17:58.758896 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.758857 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-util\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:17:58.759051 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.758913 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:17:58.759051 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:58.758925 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jbq9\" (UniqueName: \"kubernetes.io/projected/6e0a4479-80f8-40f8-a141-3f9d35f5ea98-kube-api-access-7jbq9\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:17:59.184862 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:59.184821 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" event={"ID":"1e8a326c-5b31-42d7-a1a0-8660a1333773","Type":"ContainerStarted","Data":"7a07dfd3f883997bccb3a30f951be39aa6e214a69d87ec297a952c41cc2bb59b"} Jul 13 22:17:59.186679 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:59.186653 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" event={"ID":"6e0a4479-80f8-40f8-a141-3f9d35f5ea98","Type":"ContainerDied","Data":"8fc6ed64349c5ed29344d63851595ad364d8a39463786c2a9146293319cc10ae"} Jul 13 22:17:59.186803 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:59.186686 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkpwm7" Jul 13 22:17:59.186803 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:59.186696 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fc6ed64349c5ed29344d63851595ad364d8a39463786c2a9146293319cc10ae" Jul 13 22:17:59.199799 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:59.199756 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pnl9b" podStartSLOduration=1.547106037 podStartE2EDuration="4.199742094s" totalImagesPullingTime="2.652636057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:17:59.198892745 +0000 UTC m=+283.802168973" watchObservedRunningTime="2026-07-13 22:17:59.199742094 +0000 UTC m=+283.803018320" Jul 13 22:17:59.410973 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:59.410940 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:17:59.511673 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:17:59.511640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:01.466833 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:01.466798 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:01.563177 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:01.563147 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:03.980717 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:03.980686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:04.463785 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.463746 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mqjzk"] Jul 13 22:18:04.464113 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.464097 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerName="pull" Jul 13 22:18:04.464196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.464116 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerName="pull" Jul 13 22:18:04.464196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.464130 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerName="extract" Jul 13 22:18:04.464196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.464137 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerName="extract" Jul 13 22:18:04.464196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.464161 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerName="util" Jul 13 22:18:04.464196 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.464170 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerName="util" Jul 13 22:18:04.464460 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.464246 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e0a4479-80f8-40f8-a141-3f9d35f5ea98" containerName="extract" Jul 13 22:18:04.467622 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.467601 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mqjzk" Jul 13 22:18:04.469841 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.469807 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k9tfw\"" Jul 13 22:18:04.477770 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.477749 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mqjzk"] Jul 13 22:18:04.602020 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.601990 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a051a30d-cdaf-4d81-bce0-03d252e3932c-bound-sa-token\") pod \"cert-manager-55b4d954d5-mqjzk\" (UID: \"a051a30d-cdaf-4d81-bce0-03d252e3932c\") " pod="cert-manager/cert-manager-55b4d954d5-mqjzk" Jul 13 22:18:04.602164 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.602037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqblj\" (UniqueName: \"kubernetes.io/projected/a051a30d-cdaf-4d81-bce0-03d252e3932c-kube-api-access-fqblj\") pod \"cert-manager-55b4d954d5-mqjzk\" (UID: \"a051a30d-cdaf-4d81-bce0-03d252e3932c\") " pod="cert-manager/cert-manager-55b4d954d5-mqjzk" Jul 13 22:18:04.703368 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.703335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a051a30d-cdaf-4d81-bce0-03d252e3932c-bound-sa-token\") pod \"cert-manager-55b4d954d5-mqjzk\" (UID: \"a051a30d-cdaf-4d81-bce0-03d252e3932c\") " pod="cert-manager/cert-manager-55b4d954d5-mqjzk" Jul 13 22:18:04.703525 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.703382 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqblj\" (UniqueName: \"kubernetes.io/projected/a051a30d-cdaf-4d81-bce0-03d252e3932c-kube-api-access-fqblj\") pod \"cert-manager-55b4d954d5-mqjzk\" (UID: \"a051a30d-cdaf-4d81-bce0-03d252e3932c\") " pod="cert-manager/cert-manager-55b4d954d5-mqjzk" Jul 13 22:18:04.710650 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.710619 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a051a30d-cdaf-4d81-bce0-03d252e3932c-bound-sa-token\") pod \"cert-manager-55b4d954d5-mqjzk\" (UID: \"a051a30d-cdaf-4d81-bce0-03d252e3932c\") " pod="cert-manager/cert-manager-55b4d954d5-mqjzk" Jul 13 22:18:04.710775 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.710749 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqblj\" (UniqueName: \"kubernetes.io/projected/a051a30d-cdaf-4d81-bce0-03d252e3932c-kube-api-access-fqblj\") pod \"cert-manager-55b4d954d5-mqjzk\" (UID: \"a051a30d-cdaf-4d81-bce0-03d252e3932c\") " pod="cert-manager/cert-manager-55b4d954d5-mqjzk" Jul 13 22:18:04.783831 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.783810 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mqjzk" Jul 13 22:18:04.905669 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:04.905471 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mqjzk"] Jul 13 22:18:04.907766 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:18:04.907735 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda051a30d_cdaf_4d81_bce0_03d252e3932c.slice/crio-e7f8569f67c23caa225238709dfd3be90e34dc3e1e8fcb08e077b183a3c3d6a4 WatchSource:0}: Error finding container e7f8569f67c23caa225238709dfd3be90e34dc3e1e8fcb08e077b183a3c3d6a4: Status 404 returned error can't find the container with id e7f8569f67c23caa225238709dfd3be90e34dc3e1e8fcb08e077b183a3c3d6a4 Jul 13 22:18:05.211954 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:05.211861 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mqjzk" event={"ID":"a051a30d-cdaf-4d81-bce0-03d252e3932c","Type":"ContainerStarted","Data":"df8c7f293c7fc7180ef6e29769b1ab3e36a63dffc862050acaecb6b1a10ecf0a"} Jul 13 22:18:05.211954 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:05.211902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mqjzk" event={"ID":"a051a30d-cdaf-4d81-bce0-03d252e3932c","Type":"ContainerStarted","Data":"e7f8569f67c23caa225238709dfd3be90e34dc3e1e8fcb08e077b183a3c3d6a4"} Jul 13 22:18:05.226413 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:05.226365 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mqjzk" podStartSLOduration=1.22635009 podStartE2EDuration="1.22635009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:05.225779362 +0000 UTC m=+289.829055590" watchObservedRunningTime="2026-07-13 22:18:05.22635009 +0000 UTC m=+289.829626316" Jul 13 22:18:07.607141 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:07.607104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:07.704793 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:07.704757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:09.735945 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.735906 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5"] Jul 13 22:18:09.749995 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.749969 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5"] Jul 13 22:18:09.750145 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.750072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:09.752372 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.752350 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sqrgv\"" Jul 13 22:18:09.752519 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.752350 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 22:18:09.752876 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.752846 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 22:18:09.845853 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.845814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvzh\" (UniqueName: \"kubernetes.io/projected/db9007d9-07d9-4db0-ac51-efaa504f2eed-kube-api-access-xjvzh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:09.846018 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.845869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:09.846018 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.845980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:09.871467 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.871408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:09.947371 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.947332 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:09.947570 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.947379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvzh\" (UniqueName: \"kubernetes.io/projected/db9007d9-07d9-4db0-ac51-efaa504f2eed-kube-api-access-xjvzh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:09.947570 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.947548 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:09.947799 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.947772 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:09.947839 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.947827 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:09.954687 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:09.954658 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvzh\" (UniqueName: \"kubernetes.io/projected/db9007d9-07d9-4db0-ac51-efaa504f2eed-kube-api-access-xjvzh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:10.066782 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:10.066736 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:10.213117 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:10.213093 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5"] Jul 13 22:18:10.215071 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:18:10.215042 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9007d9_07d9_4db0_ac51_efaa504f2eed.slice/crio-bf4d34f2467ebadec64a4c79932444ebd6b6950bd29e13d37e123ae74bfa890f WatchSource:0}: Error finding container bf4d34f2467ebadec64a4c79932444ebd6b6950bd29e13d37e123ae74bfa890f: Status 404 returned error can't find the container with id bf4d34f2467ebadec64a4c79932444ebd6b6950bd29e13d37e123ae74bfa890f Jul 13 22:18:10.233321 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:10.233282 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" event={"ID":"db9007d9-07d9-4db0-ac51-efaa504f2eed","Type":"ContainerStarted","Data":"bf4d34f2467ebadec64a4c79932444ebd6b6950bd29e13d37e123ae74bfa890f"} Jul 13 22:18:11.239487 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:11.239372 2581 generic.go:356] "Generic (PLEG): container finished" podID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerID="79eefaf8dcca8a2cd4ac5186bf9271a6a1968b19113a34823d902fc6bee46a74" exitCode=0 Jul 13 22:18:11.239487 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:11.239412 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" event={"ID":"db9007d9-07d9-4db0-ac51-efaa504f2eed","Type":"ContainerDied","Data":"79eefaf8dcca8a2cd4ac5186bf9271a6a1968b19113a34823d902fc6bee46a74"} Jul 13 22:18:13.250400 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:13.250365 2581 generic.go:356] "Generic (PLEG): container finished" podID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerID="d6e31e099c9aac6c83b1c80eb6a9514a85599beb007c5b5e00674afc1b58441c" exitCode=0 Jul 13 22:18:13.250882 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:13.250653 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" event={"ID":"db9007d9-07d9-4db0-ac51-efaa504f2eed","Type":"ContainerDied","Data":"d6e31e099c9aac6c83b1c80eb6a9514a85599beb007c5b5e00674afc1b58441c"} Jul 13 22:18:14.257438 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:14.257393 2581 generic.go:356] "Generic (PLEG): container finished" podID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerID="3e66961496cc816fb0851a974db32dcfe6536ede09c7bb3e26cfaf490192b175" exitCode=0 Jul 13 22:18:14.257830 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:14.257476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" event={"ID":"db9007d9-07d9-4db0-ac51-efaa504f2eed","Type":"ContainerDied","Data":"3e66961496cc816fb0851a974db32dcfe6536ede09c7bb3e26cfaf490192b175"} Jul 13 22:18:15.399996 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.399966 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:15.487986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.487950 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-util\") pod \"db9007d9-07d9-4db0-ac51-efaa504f2eed\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " Jul 13 22:18:15.488172 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.488001 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjvzh\" (UniqueName: \"kubernetes.io/projected/db9007d9-07d9-4db0-ac51-efaa504f2eed-kube-api-access-xjvzh\") pod \"db9007d9-07d9-4db0-ac51-efaa504f2eed\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " Jul 13 22:18:15.488172 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.488076 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-bundle\") pod \"db9007d9-07d9-4db0-ac51-efaa504f2eed\" (UID: \"db9007d9-07d9-4db0-ac51-efaa504f2eed\") " Jul 13 22:18:15.489068 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.489037 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-bundle" (OuterVolumeSpecName: "bundle") pod "db9007d9-07d9-4db0-ac51-efaa504f2eed" (UID: "db9007d9-07d9-4db0-ac51-efaa504f2eed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:18:15.490172 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.490145 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9007d9-07d9-4db0-ac51-efaa504f2eed-kube-api-access-xjvzh" (OuterVolumeSpecName: "kube-api-access-xjvzh") pod "db9007d9-07d9-4db0-ac51-efaa504f2eed" (UID: "db9007d9-07d9-4db0-ac51-efaa504f2eed"). InnerVolumeSpecName "kube-api-access-xjvzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:18:15.495128 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.495079 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-util" (OuterVolumeSpecName: "util") pod "db9007d9-07d9-4db0-ac51-efaa504f2eed" (UID: "db9007d9-07d9-4db0-ac51-efaa504f2eed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:18:15.589331 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.589248 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjvzh\" (UniqueName: \"kubernetes.io/projected/db9007d9-07d9-4db0-ac51-efaa504f2eed-kube-api-access-xjvzh\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:18:15.589331 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.589275 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:18:15.589331 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.589285 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db9007d9-07d9-4db0-ac51-efaa504f2eed-util\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:18:15.775382 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.775350 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:18:15.775591 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.775557 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:18:15.778213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.778190 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:18:15.778346 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.778293 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:18:15.785713 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:15.785690 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 22:18:16.268624 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:16.268593 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" event={"ID":"db9007d9-07d9-4db0-ac51-efaa504f2eed","Type":"ContainerDied","Data":"bf4d34f2467ebadec64a4c79932444ebd6b6950bd29e13d37e123ae74bfa890f"} Jul 13 22:18:16.268818 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:16.268644 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf4d34f2467ebadec64a4c79932444ebd6b6950bd29e13d37e123ae74bfa890f" Jul 13 22:18:16.268818 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:16.268604 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcrgf5" Jul 13 22:18:24.320280 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:24.320247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:25.848762 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:25.848732 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:26.671567 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:26.671529 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:26.778219 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:26.778186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:27.285030 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.285000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:27.499593 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.499541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:27.602108 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.602031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:27.618206 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.618185 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g"] Jul 13 22:18:27.618478 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.618466 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerName="pull" Jul 13 22:18:27.618532 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.618480 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerName="pull" Jul 13 22:18:27.618532 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.618494 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerName="extract" Jul 13 22:18:27.618532 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.618500 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerName="extract" Jul 13 22:18:27.618532 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.618515 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerName="util" Jul 13 22:18:27.618532 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.618519 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerName="util" Jul 13 22:18:27.618684 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.618567 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="db9007d9-07d9-4db0-ac51-efaa504f2eed" containerName="extract" Jul 13 22:18:27.620285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.620270 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.622854 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.622834 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 22:18:27.622963 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.622889 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 22:18:27.623108 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.623085 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2l2fh\"" Jul 13 22:18:27.623108 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.623100 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 22:18:27.623382 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.623361 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 22:18:27.641626 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.641604 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g"] Jul 13 22:18:27.690401 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.690374 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb66788-ff43-438a-819e-ee9ae4088d4a-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.690544 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.690409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dfb66788-ff43-438a-819e-ee9ae4088d4a-manifests\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.690544 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.690481 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfb66788-ff43-438a-819e-ee9ae4088d4a-tmp\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.690544 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.690516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dfb66788-ff43-438a-819e-ee9ae4088d4a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.690660 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.690561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vw75\" (UniqueName: \"kubernetes.io/projected/dfb66788-ff43-438a-819e-ee9ae4088d4a-kube-api-access-4vw75\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.790910 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.790885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb66788-ff43-438a-819e-ee9ae4088d4a-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.791079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.790929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dfb66788-ff43-438a-819e-ee9ae4088d4a-manifests\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.791079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.790956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfb66788-ff43-438a-819e-ee9ae4088d4a-tmp\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.791079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.790985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dfb66788-ff43-438a-819e-ee9ae4088d4a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.791079 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.791037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vw75\" (UniqueName: \"kubernetes.io/projected/dfb66788-ff43-438a-819e-ee9ae4088d4a-kube-api-access-4vw75\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.791404 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.791368 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dfb66788-ff43-438a-819e-ee9ae4088d4a-manifests\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.791838 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.791809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:27.793412 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.793376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfb66788-ff43-438a-819e-ee9ae4088d4a-tmp\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.793525 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.793469 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb66788-ff43-438a-819e-ee9ae4088d4a-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.793525 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.793510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dfb66788-ff43-438a-819e-ee9ae4088d4a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.803469 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.803450 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vw75\" (UniqueName: \"kubernetes.io/projected/dfb66788-ff43-438a-819e-ee9ae4088d4a-kube-api-access-4vw75\") pod \"opendatahub-operator-controller-manager-d5bf5468b-6b67g\" (UID: \"dfb66788-ff43-438a-819e-ee9ae4088d4a\") " pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.885742 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.885672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:27.930794 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.930768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:27.986035 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:27.985986 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:28.060743 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:28.060720 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g"] Jul 13 22:18:28.062893 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:18:28.062866 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb66788_ff43_438a_819e_ee9ae4088d4a.slice/crio-afebd4d64b644732c3da80e9e12d7b9c531f70e65f98ea6718007eeab01f861d WatchSource:0}: Error finding container afebd4d64b644732c3da80e9e12d7b9c531f70e65f98ea6718007eeab01f861d: Status 404 returned error can't find the container with id afebd4d64b644732c3da80e9e12d7b9c531f70e65f98ea6718007eeab01f861d Jul 13 22:18:28.064096 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:28.064063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:28.064735 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:28.064719 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 22:18:28.133385 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:28.133359 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:28.320832 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:28.320805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" event={"ID":"dfb66788-ff43-438a-819e-ee9ae4088d4a","Type":"ContainerStarted","Data":"afebd4d64b644732c3da80e9e12d7b9c531f70e65f98ea6718007eeab01f861d"} Jul 13 22:18:31.337481 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:31.337443 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" event={"ID":"dfb66788-ff43-438a-819e-ee9ae4088d4a","Type":"ContainerStarted","Data":"b31cc226fa6f1d9ddffcd64f08a57883058026f85af87ea9b92504781a576ca8"} Jul 13 22:18:32.343415 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:32.343376 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfb66788-ff43-438a-819e-ee9ae4088d4a" containerID="b31cc226fa6f1d9ddffcd64f08a57883058026f85af87ea9b92504781a576ca8" exitCode=0 Jul 13 22:18:32.343892 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:32.343456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" event={"ID":"dfb66788-ff43-438a-819e-ee9ae4088d4a","Type":"ContainerDied","Data":"b31cc226fa6f1d9ddffcd64f08a57883058026f85af87ea9b92504781a576ca8"} Jul 13 22:18:33.351281 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:33.351247 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" event={"ID":"dfb66788-ff43-438a-819e-ee9ae4088d4a","Type":"ContainerStarted","Data":"140c5571277f56df8c4a00ed011e5278ae114f3b5db06421b187abbd3114f9c5"} Jul 13 22:18:33.351758 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:33.351371 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:33.377533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:33.377481 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" podStartSLOduration=1.789667239 podStartE2EDuration="6.377465942s" totalImagesPullingTime="3.511718679s" totalInitContainerRuntime="1.076080024s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:33.376481466 +0000 UTC m=+317.979757686" watchObservedRunningTime="2026-07-13 22:18:33.377465942 +0000 UTC m=+317.980742170" Jul 13 22:18:39.474716 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:39.474681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:39.574940 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:39.574913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:44.358054 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:44.358018 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d5bf5468b-6b67g" Jul 13 22:18:46.681091 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:46.681058 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:46.868744 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:46.868707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:47.166152 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.166113 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:47.273770 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.273736 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp"] Jul 13 22:18:47.284889 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.284860 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.291141 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.291115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 22:18:47.293699 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.293675 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp"] Jul 13 22:18:47.294452 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.294430 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 22:18:47.358625 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.358596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/010f49e0-93f7-49d9-b7ae-f0a740745eb1-tls-certs\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.358770 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.358683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccf46\" (UniqueName: \"kubernetes.io/projected/010f49e0-93f7-49d9-b7ae-f0a740745eb1-kube-api-access-ccf46\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.358770 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.358730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/010f49e0-93f7-49d9-b7ae-f0a740745eb1-tmp\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.459323 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.459249 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/010f49e0-93f7-49d9-b7ae-f0a740745eb1-tls-certs\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.459323 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.459300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccf46\" (UniqueName: \"kubernetes.io/projected/010f49e0-93f7-49d9-b7ae-f0a740745eb1-kube-api-access-ccf46\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.459556 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.459344 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/010f49e0-93f7-49d9-b7ae-f0a740745eb1-tmp\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.459556 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:18:47.459414 2581 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 13 22:18:47.459556 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:18:47.459522 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/010f49e0-93f7-49d9-b7ae-f0a740745eb1-tls-certs podName:010f49e0-93f7-49d9-b7ae-f0a740745eb1 nodeName:}" failed. No retries permitted until 2026-07-13 22:18:47.959498626 +0000 UTC m=+332.562774831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/010f49e0-93f7-49d9-b7ae-f0a740745eb1-tls-certs") pod "kube-auth-proxy-67f58f88b6-nnmpp" (UID: "010f49e0-93f7-49d9-b7ae-f0a740745eb1") : secret "kube-auth-proxy-tls" not found Jul 13 22:18:47.461563 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.461541 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/010f49e0-93f7-49d9-b7ae-f0a740745eb1-tmp\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.470348 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.470328 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccf46\" (UniqueName: \"kubernetes.io/projected/010f49e0-93f7-49d9-b7ae-f0a740745eb1-kube-api-access-ccf46\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.557992 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.557950 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kw5q2"] Jul 13 22:18:47.561554 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.561530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:47.564270 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.564244 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pgsvm\"" Jul 13 22:18:47.567969 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.567945 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 13 22:18:47.575337 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.575318 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kw5q2"] Jul 13 22:18:47.635742 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.635710 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:47.662023 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.661987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dde19b41-3b72-44a8-8d21-b2d560ba7071-cert\") pod \"odh-model-controller-7998c67dc4-kw5q2\" (UID: \"dde19b41-3b72-44a8-8d21-b2d560ba7071\") " pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:47.662177 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.662077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2zcg\" (UniqueName: \"kubernetes.io/projected/dde19b41-3b72-44a8-8d21-b2d560ba7071-kube-api-access-f2zcg\") pod \"odh-model-controller-7998c67dc4-kw5q2\" (UID: \"dde19b41-3b72-44a8-8d21-b2d560ba7071\") " pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:47.733172 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.733064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:47.763405 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.763373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dde19b41-3b72-44a8-8d21-b2d560ba7071-cert\") pod \"odh-model-controller-7998c67dc4-kw5q2\" (UID: \"dde19b41-3b72-44a8-8d21-b2d560ba7071\") " pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:47.763581 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.763470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zcg\" (UniqueName: \"kubernetes.io/projected/dde19b41-3b72-44a8-8d21-b2d560ba7071-kube-api-access-f2zcg\") pod \"odh-model-controller-7998c67dc4-kw5q2\" (UID: \"dde19b41-3b72-44a8-8d21-b2d560ba7071\") " pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:47.763581 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:18:47.763539 2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 13 22:18:47.763674 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:18:47.763610 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde19b41-3b72-44a8-8d21-b2d560ba7071-cert podName:dde19b41-3b72-44a8-8d21-b2d560ba7071 nodeName:}" failed. No retries permitted until 2026-07-13 22:18:48.263594582 +0000 UTC m=+332.866870787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dde19b41-3b72-44a8-8d21-b2d560ba7071-cert") pod "odh-model-controller-7998c67dc4-kw5q2" (UID: "dde19b41-3b72-44a8-8d21-b2d560ba7071") : secret "odh-model-controller-webhook-cert" not found Jul 13 22:18:47.778360 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.778322 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zcg\" (UniqueName: \"kubernetes.io/projected/dde19b41-3b72-44a8-8d21-b2d560ba7071-kube-api-access-f2zcg\") pod \"odh-model-controller-7998c67dc4-kw5q2\" (UID: \"dde19b41-3b72-44a8-8d21-b2d560ba7071\") " pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:47.829145 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.829111 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:47.965194 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.965149 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/010f49e0-93f7-49d9-b7ae-f0a740745eb1-tls-certs\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.967630 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.967606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/010f49e0-93f7-49d9-b7ae-f0a740745eb1-tls-certs\") pod \"kube-auth-proxy-67f58f88b6-nnmpp\" (UID: \"010f49e0-93f7-49d9-b7ae-f0a740745eb1\") " pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:47.997168 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:47.997097 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:48.195619 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.195584 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" Jul 13 22:18:48.269025 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.268987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dde19b41-3b72-44a8-8d21-b2d560ba7071-cert\") pod \"odh-model-controller-7998c67dc4-kw5q2\" (UID: \"dde19b41-3b72-44a8-8d21-b2d560ba7071\") " pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:48.273231 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.273210 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dde19b41-3b72-44a8-8d21-b2d560ba7071-cert\") pod \"odh-model-controller-7998c67dc4-kw5q2\" (UID: \"dde19b41-3b72-44a8-8d21-b2d560ba7071\") " pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:48.340552 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.340478 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp"] Jul 13 22:18:48.342829 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:18:48.342792 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010f49e0_93f7_49d9_b7ae_f0a740745eb1.slice/crio-d498bb98b535a677384e8a806c9d76e6fe9e9c33870fb44aba5374610f177bdf WatchSource:0}: Error finding container d498bb98b535a677384e8a806c9d76e6fe9e9c33870fb44aba5374610f177bdf: Status 404 returned error can't find the container with id d498bb98b535a677384e8a806c9d76e6fe9e9c33870fb44aba5374610f177bdf Jul 13 22:18:48.402534 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.402507 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w7tvz"] Jul 13 22:18:48.407123 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.407103 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:18:48.409491 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.409461 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 13 22:18:48.418439 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.418397 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" event={"ID":"010f49e0-93f7-49d9-b7ae-f0a740745eb1","Type":"ContainerStarted","Data":"d498bb98b535a677384e8a806c9d76e6fe9e9c33870fb44aba5374610f177bdf"} Jul 13 22:18:48.424468 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.424448 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w7tvz"] Jul 13 22:18:48.427132 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.427094 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:48.470283 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.470257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/accb3645-de69-4da9-8af3-367fd144dd36-tls-certs\") pod \"model-serving-api-54d89bd5fc-w7tvz\" (UID: \"accb3645-de69-4da9-8af3-367fd144dd36\") " pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:18:48.470436 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.470294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvr5\" (UniqueName: \"kubernetes.io/projected/accb3645-de69-4da9-8af3-367fd144dd36-kube-api-access-xjvr5\") pod \"model-serving-api-54d89bd5fc-w7tvz\" (UID: \"accb3645-de69-4da9-8af3-367fd144dd36\") " pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:18:48.472227 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.472206 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:48.570991 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.570963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/accb3645-de69-4da9-8af3-367fd144dd36-tls-certs\") pod \"model-serving-api-54d89bd5fc-w7tvz\" (UID: \"accb3645-de69-4da9-8af3-367fd144dd36\") " pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:18:48.571127 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.571006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvr5\" (UniqueName: \"kubernetes.io/projected/accb3645-de69-4da9-8af3-367fd144dd36-kube-api-access-xjvr5\") pod \"model-serving-api-54d89bd5fc-w7tvz\" (UID: \"accb3645-de69-4da9-8af3-367fd144dd36\") " pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:18:48.573804 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.573744 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/accb3645-de69-4da9-8af3-367fd144dd36-tls-certs\") pod \"model-serving-api-54d89bd5fc-w7tvz\" (UID: \"accb3645-de69-4da9-8af3-367fd144dd36\") " pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:18:48.581946 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.581904 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvr5\" (UniqueName: \"kubernetes.io/projected/accb3645-de69-4da9-8af3-367fd144dd36-kube-api-access-xjvr5\") pod \"model-serving-api-54d89bd5fc-w7tvz\" (UID: \"accb3645-de69-4da9-8af3-367fd144dd36\") " pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:18:48.591805 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.591745 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:48.596895 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.596870 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8"] Jul 13 22:18:48.601192 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.601169 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.604004 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.603986 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 22:18:48.604144 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.604008 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 22:18:48.604493 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.604405 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 22:18:48.604594 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.604579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2kxsc\"" Jul 13 22:18:48.604652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.604625 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 22:18:48.614561 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.614535 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8"] Jul 13 22:18:48.622309 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.622232 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kw5q2"] Jul 13 22:18:48.625124 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:18:48.625099 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde19b41_3b72_44a8_8d21_b2d560ba7071.slice/crio-46255cc86faeb7c7c4c5738d7ee57754709f5708c511d4e5456883f2e573a3d9 WatchSource:0}: Error finding container 46255cc86faeb7c7c4c5738d7ee57754709f5708c511d4e5456883f2e573a3d9: Status 404 returned error can't find the container with id 46255cc86faeb7c7c4c5738d7ee57754709f5708c511d4e5456883f2e573a3d9 Jul 13 22:18:48.662073 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.662033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:48.671703 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.671682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de9c526-498c-46c1-9c5f-85da82af4bb0-local-certs\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.671783 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.671711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.671783 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.671748 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-cacerts\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.671904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.671885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.671960 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.671926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2lm9\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-kube-api-access-v2lm9\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.672016 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.671972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.672071 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.672021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-token\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.717298 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.717273 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:18:48.773411 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.773307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.773849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.773461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2lm9\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-kube-api-access-v2lm9\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.773849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.773491 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.773849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.773531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-token\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.773849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.773561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de9c526-498c-46c1-9c5f-85da82af4bb0-local-certs\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.773849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.773583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.773849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.773613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-cacerts\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.774962 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.774873 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.776437 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.776389 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-cacerts\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.778071 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.777870 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.778175 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.778102 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de9c526-498c-46c1-9c5f-85da82af4bb0-local-certs\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.778870 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.778847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.782346 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.782320 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2lm9\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-kube-api-access-v2lm9\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.782953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.782924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-token\") pod \"istiod-openshift-gateway-7574459656-7fcz8\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:48.857118 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.857084 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-w7tvz"] Jul 13 22:18:48.860340 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:18:48.860308 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaccb3645_de69_4da9_8af3_367fd144dd36.slice/crio-07acf17e987b438bfeb97e23bb9239fe54e4e01ccb7536b5dc074c1ff8d9d00b WatchSource:0}: Error finding container 07acf17e987b438bfeb97e23bb9239fe54e4e01ccb7536b5dc074c1ff8d9d00b: Status 404 returned error can't find the container with id 07acf17e987b438bfeb97e23bb9239fe54e4e01ccb7536b5dc074c1ff8d9d00b Jul 13 22:18:48.910932 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:48.910907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:49.060775 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:49.060749 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8"] Jul 13 22:18:49.063332 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:18:49.063302 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de9c526_498c_46c1_9c5f_85da82af4bb0.slice/crio-366fe982b8a8663de24a0119662368524e1c23c5b7d56afbd7d93458b83b235f WatchSource:0}: Error finding container 366fe982b8a8663de24a0119662368524e1c23c5b7d56afbd7d93458b83b235f: Status 404 returned error can't find the container with id 366fe982b8a8663de24a0119662368524e1c23c5b7d56afbd7d93458b83b235f Jul 13 22:18:49.426512 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:49.426407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" event={"ID":"accb3645-de69-4da9-8af3-367fd144dd36","Type":"ContainerStarted","Data":"07acf17e987b438bfeb97e23bb9239fe54e4e01ccb7536b5dc074c1ff8d9d00b"} Jul 13 22:18:49.428110 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:49.428071 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" event={"ID":"7de9c526-498c-46c1-9c5f-85da82af4bb0","Type":"ContainerStarted","Data":"366fe982b8a8663de24a0119662368524e1c23c5b7d56afbd7d93458b83b235f"} Jul 13 22:18:49.429385 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:49.429361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" event={"ID":"dde19b41-3b72-44a8-8d21-b2d560ba7071","Type":"ContainerStarted","Data":"46255cc86faeb7c7c4c5738d7ee57754709f5708c511d4e5456883f2e573a3d9"} Jul 13 22:18:49.714407 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:49.714319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:54.099356 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.091152 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 13 22:18:54.099356 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.091261 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 13 22:18:54.469495 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.469385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" event={"ID":"dde19b41-3b72-44a8-8d21-b2d560ba7071","Type":"ContainerStarted","Data":"0e35e5720afbaa1ef558184f815a1f6b4c6e060db7331328422cf15c7010475d"} Jul 13 22:18:54.469495 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.469486 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:18:54.471008 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.470978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" event={"ID":"010f49e0-93f7-49d9-b7ae-f0a740745eb1","Type":"ContainerStarted","Data":"0c3dc7c5d4eb7a9b16bf54ff58e5fd09f610f2739b4d90badc28c0e443dcbaf6"} Jul 13 22:18:54.472767 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.472703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" event={"ID":"accb3645-de69-4da9-8af3-367fd144dd36","Type":"ContainerStarted","Data":"6a8892ab7412a6f5c3e2e0959d1a51c6fabeab847ab485c06747263a9c7a348f"} Jul 13 22:18:54.472882 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.472778 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:18:54.474261 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.474239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" event={"ID":"7de9c526-498c-46c1-9c5f-85da82af4bb0","Type":"ContainerStarted","Data":"df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43"} Jul 13 22:18:54.474386 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.474347 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:54.488076 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.488029 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" podStartSLOduration=2.011450933 podStartE2EDuration="7.488012602s" totalImagesPullingTime="5.476561669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:54.486139196 +0000 UTC m=+339.089415423" watchObservedRunningTime="2026-07-13 22:18:54.488012602 +0000 UTC m=+339.091288829" Jul 13 22:18:54.502126 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.502086 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" podStartSLOduration=1.314223672 podStartE2EDuration="6.502076483s" totalImagesPullingTime="5.187852811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:54.500371649 +0000 UTC m=+339.103647869" watchObservedRunningTime="2026-07-13 22:18:54.502076483 +0000 UTC m=+339.105352710" Jul 13 22:18:54.518954 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.518915 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" podStartSLOduration=1.494109511 podStartE2EDuration="6.518902349s" totalImagesPullingTime="5.024792838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:54.517151272 +0000 UTC m=+339.120427500" watchObservedRunningTime="2026-07-13 22:18:54.518902349 +0000 UTC m=+339.122178577" Jul 13 22:18:54.534143 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:54.534092 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67f58f88b6-nnmpp" podStartSLOduration=1.824439811 podStartE2EDuration="7.534079123s" totalImagesPullingTime="5.709639312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:18:54.532404686 +0000 UTC m=+339.135680914" watchObservedRunningTime="2026-07-13 22:18:54.534079123 +0000 UTC m=+339.137355349" Jul 13 22:18:55.047371 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:55.047331 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:55.147939 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:55.147903 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:55.480128 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:55.480053 2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-7fcz8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 22:18:55.480263 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:55.480132 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" podUID="7de9c526-498c-46c1-9c5f-85da82af4bb0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 22:18:56.167679 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:56.167642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:56.561480 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:56.561440 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:56.657873 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:56.657842 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:58.479471 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:58.479412 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:18:59.085037 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.085003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:59.167355 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.167326 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zjss2"] Jul 13 22:18:59.170731 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.170711 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:18:59.175978 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.175947 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dpm2b\"" Jul 13 22:18:59.176089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.176072 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 13 22:18:59.185372 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.185353 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd"] Jul 13 22:18:59.188512 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.188494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:18:59.189223 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.189205 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zjss2"] Jul 13 22:18:59.191924 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.191904 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dr7q5\"" Jul 13 22:18:59.192025 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.191980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 13 22:18:59.201746 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.201726 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd"] Jul 13 22:18:59.217318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.217294 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:59.267471 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.267443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hljr2\" (UniqueName: \"kubernetes.io/projected/ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8-kube-api-access-hljr2\") pod \"llmisvc-controller-manager-777c6bd7d5-x6zkd\" (UID: \"ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:18:59.267590 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.267474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a592c933-bc86-4649-ba91-629c3be8fc49-cert\") pod \"kserve-controller-manager-d6f4b65b8-zjss2\" (UID: \"a592c933-bc86-4649-ba91-629c3be8fc49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:18:59.267590 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.267574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt4gr\" (UniqueName: \"kubernetes.io/projected/a592c933-bc86-4649-ba91-629c3be8fc49-kube-api-access-dt4gr\") pod \"kserve-controller-manager-d6f4b65b8-zjss2\" (UID: \"a592c933-bc86-4649-ba91-629c3be8fc49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:18:59.267699 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.267644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x6zkd\" (UID: \"ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:18:59.289301 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.289275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:59.368533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.368473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljr2\" (UniqueName: \"kubernetes.io/projected/ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8-kube-api-access-hljr2\") pod \"llmisvc-controller-manager-777c6bd7d5-x6zkd\" (UID: \"ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:18:59.368533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.368505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a592c933-bc86-4649-ba91-629c3be8fc49-cert\") pod \"kserve-controller-manager-d6f4b65b8-zjss2\" (UID: \"a592c933-bc86-4649-ba91-629c3be8fc49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:18:59.368706 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.368558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt4gr\" (UniqueName: \"kubernetes.io/projected/a592c933-bc86-4649-ba91-629c3be8fc49-kube-api-access-dt4gr\") pod \"kserve-controller-manager-d6f4b65b8-zjss2\" (UID: \"a592c933-bc86-4649-ba91-629c3be8fc49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:18:59.368706 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.368586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x6zkd\" (UID: \"ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:18:59.371098 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.371066 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a592c933-bc86-4649-ba91-629c3be8fc49-cert\") pod \"kserve-controller-manager-d6f4b65b8-zjss2\" (UID: \"a592c933-bc86-4649-ba91-629c3be8fc49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:18:59.371276 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.371257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x6zkd\" (UID: \"ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:18:59.383399 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.383373 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt4gr\" (UniqueName: \"kubernetes.io/projected/a592c933-bc86-4649-ba91-629c3be8fc49-kube-api-access-dt4gr\") pod \"kserve-controller-manager-d6f4b65b8-zjss2\" (UID: \"a592c933-bc86-4649-ba91-629c3be8fc49\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:18:59.383854 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.383835 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hljr2\" (UniqueName: \"kubernetes.io/projected/ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8-kube-api-access-hljr2\") pod \"llmisvc-controller-manager-777c6bd7d5-x6zkd\" (UID: \"ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:18:59.400994 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.400966 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:59.480485 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.480455 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:18:59.509162 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.509133 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:18:59.547762 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.547673 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:18:59.684614 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.684580 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zjss2"] Jul 13 22:18:59.687070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.687045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd"] Jul 13 22:18:59.687636 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:18:59.687612 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda592c933_bc86_4649_ba91_629c3be8fc49.slice/crio-c46df2aa637a65867f2563ae70534cdd33b70f467782c47ae8192f9f51b32ef5 WatchSource:0}: Error finding container c46df2aa637a65867f2563ae70534cdd33b70f467782c47ae8192f9f51b32ef5: Status 404 returned error can't find the container with id c46df2aa637a65867f2563ae70534cdd33b70f467782c47ae8192f9f51b32ef5 Jul 13 22:18:59.688013 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:18:59.687991 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac18bcc6_bc98_4aa8_9d16_7b80c057a5c8.slice/crio-f2e1065222aee7a163d9569c18664bee0f9ad85747ab9ffd5729c493a7381626 WatchSource:0}: Error finding container f2e1065222aee7a163d9569c18664bee0f9ad85747ab9ffd5729c493a7381626: Status 404 returned error can't find the container with id f2e1065222aee7a163d9569c18664bee0f9ad85747ab9ffd5729c493a7381626 Jul 13 22:18:59.702292 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:18:59.702263 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:19:00.518491 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:00.518450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" event={"ID":"ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8","Type":"ContainerStarted","Data":"f2e1065222aee7a163d9569c18664bee0f9ad85747ab9ffd5729c493a7381626"} Jul 13 22:19:00.519991 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:00.519955 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" event={"ID":"a592c933-bc86-4649-ba91-629c3be8fc49","Type":"ContainerStarted","Data":"c46df2aa637a65867f2563ae70534cdd33b70f467782c47ae8192f9f51b32ef5"} Jul 13 22:19:01.817765 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:01.817732 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8"] Jul 13 22:19:01.818218 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:01.817960 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" podUID="7de9c526-498c-46c1-9c5f-85da82af4bb0" containerName="discovery" containerID="cri-o://df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43" gracePeriod=30 Jul 13 22:19:02.093038 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.093016 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:19:02.194640 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.194611 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-ca-configmap\") pod \"7de9c526-498c-46c1-9c5f-85da82af4bb0\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " Jul 13 22:19:02.194780 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.194652 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-dns-cert\") pod \"7de9c526-498c-46c1-9c5f-85da82af4bb0\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " Jul 13 22:19:02.194780 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.194706 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-kubeconfig\") pod \"7de9c526-498c-46c1-9c5f-85da82af4bb0\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " Jul 13 22:19:02.194780 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.194724 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2lm9\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-kube-api-access-v2lm9\") pod \"7de9c526-498c-46c1-9c5f-85da82af4bb0\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " Jul 13 22:19:02.194780 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.194750 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-token\") pod \"7de9c526-498c-46c1-9c5f-85da82af4bb0\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " Jul 13 22:19:02.195005 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.194794 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-cacerts\") pod \"7de9c526-498c-46c1-9c5f-85da82af4bb0\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " Jul 13 22:19:02.195005 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.194841 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de9c526-498c-46c1-9c5f-85da82af4bb0-local-certs\") pod \"7de9c526-498c-46c1-9c5f-85da82af4bb0\" (UID: \"7de9c526-498c-46c1-9c5f-85da82af4bb0\") " Jul 13 22:19:02.195121 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.195007 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7de9c526-498c-46c1-9c5f-85da82af4bb0" (UID: "7de9c526-498c-46c1-9c5f-85da82af4bb0"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:19:02.195170 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.195125 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-ca-configmap\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:19:02.197191 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.197158 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-cacerts" (OuterVolumeSpecName: "cacerts") pod "7de9c526-498c-46c1-9c5f-85da82af4bb0" (UID: "7de9c526-498c-46c1-9c5f-85da82af4bb0"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:19:02.197353 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.197297 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-kube-api-access-v2lm9" (OuterVolumeSpecName: "kube-api-access-v2lm9") pod "7de9c526-498c-46c1-9c5f-85da82af4bb0" (UID: "7de9c526-498c-46c1-9c5f-85da82af4bb0"). InnerVolumeSpecName "kube-api-access-v2lm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:19:02.197353 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.197333 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-token" (OuterVolumeSpecName: "istio-token") pod "7de9c526-498c-46c1-9c5f-85da82af4bb0" (UID: "7de9c526-498c-46c1-9c5f-85da82af4bb0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:19:02.197538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.197374 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7de9c526-498c-46c1-9c5f-85da82af4bb0" (UID: "7de9c526-498c-46c1-9c5f-85da82af4bb0"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:19:02.197538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.197380 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de9c526-498c-46c1-9c5f-85da82af4bb0-local-certs" (OuterVolumeSpecName: "local-certs") pod "7de9c526-498c-46c1-9c5f-85da82af4bb0" (UID: "7de9c526-498c-46c1-9c5f-85da82af4bb0"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:19:02.197538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.197533 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7de9c526-498c-46c1-9c5f-85da82af4bb0" (UID: "7de9c526-498c-46c1-9c5f-85da82af4bb0"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:19:02.296521 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.296480 2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-cacerts\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:19:02.296521 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.296520 2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7de9c526-498c-46c1-9c5f-85da82af4bb0-local-certs\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:19:02.296762 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.296536 2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-csr-dns-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:19:02.296762 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.296549 2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-kubeconfig\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:19:02.296762 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.296562 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2lm9\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-kube-api-access-v2lm9\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:19:02.296762 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.296576 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7de9c526-498c-46c1-9c5f-85da82af4bb0-istio-token\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:19:02.533914 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.533876 2581 generic.go:356] "Generic (PLEG): container finished" podID="7de9c526-498c-46c1-9c5f-85da82af4bb0" containerID="df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43" exitCode=0 Jul 13 22:19:02.534103 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.533921 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" event={"ID":"7de9c526-498c-46c1-9c5f-85da82af4bb0","Type":"ContainerDied","Data":"df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43"} Jul 13 22:19:02.534103 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.533934 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" Jul 13 22:19:02.534103 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.533976 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8" event={"ID":"7de9c526-498c-46c1-9c5f-85da82af4bb0","Type":"ContainerDied","Data":"366fe982b8a8663de24a0119662368524e1c23c5b7d56afbd7d93458b83b235f"} Jul 13 22:19:02.534103 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.534003 2581 scope.go:117] "RemoveContainer" containerID="df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43" Jul 13 22:19:02.560867 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.560837 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8"] Jul 13 22:19:02.564859 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.564802 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7fcz8"] Jul 13 22:19:02.755558 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.755526 2581 scope.go:117] "RemoveContainer" containerID="df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43" Jul 13 22:19:02.755948 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:19:02.755920 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43\": container with ID starting with df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43 not found: ID does not exist" containerID="df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43" Jul 13 22:19:02.756062 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:02.755958 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43"} err="failed to get container status \"df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43\": rpc error: code = NotFound desc = could not find container \"df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43\": container with ID starting with df471636ec2a7b113b7071eebfa09f618ad735fb31b724b8415f261ffbc3ff43 not found: ID does not exist" Jul 13 22:19:03.541305 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:03.541267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" event={"ID":"a592c933-bc86-4649-ba91-629c3be8fc49","Type":"ContainerStarted","Data":"0023368ad8fdfdabda3dc3270669855c2b188f40a934d145165b09aae4fd7988"} Jul 13 22:19:03.541691 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:03.541345 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:19:03.557010 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:03.556971 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" podStartSLOduration=1.431606774 podStartE2EDuration="4.556956526s" totalImagesPullingTime="3.125349752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:19:03.55575603 +0000 UTC m=+348.159032258" watchObservedRunningTime="2026-07-13 22:19:03.556956526 +0000 UTC m=+348.160232753" Jul 13 22:19:03.906838 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:03.906762 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de9c526-498c-46c1-9c5f-85da82af4bb0" path="/var/lib/kubelet/pods/7de9c526-498c-46c1-9c5f-85da82af4bb0/volumes" Jul 13 22:19:04.548125 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:04.548090 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" event={"ID":"ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8","Type":"ContainerStarted","Data":"05aab77b36d93aea220613dbc1501c7692a203d222b008efd25b5d8147474c0d"} Jul 13 22:19:04.548532 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:04.548165 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:19:04.563236 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:04.563189 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" podStartSLOduration=1.7334431430000001 podStartE2EDuration="5.563176126s" totalImagesPullingTime="3.829732983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:19:04.562119713 +0000 UTC m=+349.165395941" watchObservedRunningTime="2026-07-13 22:19:04.563176126 +0000 UTC m=+349.166452353" Jul 13 22:19:05.481008 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:05.480980 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kw5q2" Jul 13 22:19:05.484497 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:05.484475 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-w7tvz" Jul 13 22:19:34.553508 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:34.553474 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zjss2" Jul 13 22:19:35.556211 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:35.556181 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6zkd" Jul 13 22:19:48.268077 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.268035 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:19:48.367983 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.367945 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:19:48.390841 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.390815 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rk8pc"] Jul 13 22:19:48.391206 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.391190 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de9c526-498c-46c1-9c5f-85da82af4bb0" containerName="discovery" Jul 13 22:19:48.391284 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.391208 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de9c526-498c-46c1-9c5f-85da82af4bb0" containerName="discovery" Jul 13 22:19:48.391339 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.391300 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de9c526-498c-46c1-9c5f-85da82af4bb0" containerName="discovery" Jul 13 22:19:48.393507 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.393487 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" Jul 13 22:19:48.395441 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.395408 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-thwrb\"" Jul 13 22:19:48.395550 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.395439 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 22:19:48.396004 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.395985 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 22:19:48.403205 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.403186 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rk8pc"] Jul 13 22:19:48.437076 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.437046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:19:48.469249 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.469224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7fhl\" (UniqueName: \"kubernetes.io/projected/9eceb5e4-9c93-49a4-bca5-c766902dc884-kube-api-access-d7fhl\") pod \"kuadrant-operator-catalog-rk8pc\" (UID: \"9eceb5e4-9c93-49a4-bca5-c766902dc884\") " pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" Jul 13 22:19:48.570581 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.570508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7fhl\" (UniqueName: \"kubernetes.io/projected/9eceb5e4-9c93-49a4-bca5-c766902dc884-kube-api-access-d7fhl\") pod \"kuadrant-operator-catalog-rk8pc\" (UID: \"9eceb5e4-9c93-49a4-bca5-c766902dc884\") " pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" Jul 13 22:19:48.578281 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.578256 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7fhl\" (UniqueName: \"kubernetes.io/projected/9eceb5e4-9c93-49a4-bca5-c766902dc884-kube-api-access-d7fhl\") pod \"kuadrant-operator-catalog-rk8pc\" (UID: \"9eceb5e4-9c93-49a4-bca5-c766902dc884\") " pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" Jul 13 22:19:48.704352 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.704312 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" Jul 13 22:19:48.749946 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.749916 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rk8pc"] Jul 13 22:19:48.831789 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.831763 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rk8pc"] Jul 13 22:19:48.833628 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:19:48.833599 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eceb5e4_9c93_49a4_bca5_c766902dc884.slice/crio-ed0f9113182e37db77110f5fd0ae8f345cc84280a4664ae2416a06c5c24e0630 WatchSource:0}: Error finding container ed0f9113182e37db77110f5fd0ae8f345cc84280a4664ae2416a06c5c24e0630: Status 404 returned error can't find the container with id ed0f9113182e37db77110f5fd0ae8f345cc84280a4664ae2416a06c5c24e0630 Jul 13 22:19:48.959547 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.959518 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vps6"] Jul 13 22:19:48.962464 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.962447 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vps6" Jul 13 22:19:48.969378 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:48.969352 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vps6"] Jul 13 22:19:49.076563 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:49.076534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p6mj\" (UniqueName: \"kubernetes.io/projected/9b8afbc8-b9ca-4732-8dea-1a1abe0713f3-kube-api-access-6p6mj\") pod \"kuadrant-operator-catalog-7vps6\" (UID: \"9b8afbc8-b9ca-4732-8dea-1a1abe0713f3\") " pod="kuadrant-system/kuadrant-operator-catalog-7vps6" Jul 13 22:19:49.177678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:49.177593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p6mj\" (UniqueName: \"kubernetes.io/projected/9b8afbc8-b9ca-4732-8dea-1a1abe0713f3-kube-api-access-6p6mj\") pod \"kuadrant-operator-catalog-7vps6\" (UID: \"9b8afbc8-b9ca-4732-8dea-1a1abe0713f3\") " pod="kuadrant-system/kuadrant-operator-catalog-7vps6" Jul 13 22:19:49.184830 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:49.184808 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p6mj\" (UniqueName: \"kubernetes.io/projected/9b8afbc8-b9ca-4732-8dea-1a1abe0713f3-kube-api-access-6p6mj\") pod \"kuadrant-operator-catalog-7vps6\" (UID: \"9b8afbc8-b9ca-4732-8dea-1a1abe0713f3\") " pod="kuadrant-system/kuadrant-operator-catalog-7vps6" Jul 13 22:19:49.272667 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:49.272644 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vps6" Jul 13 22:19:49.394366 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:49.394341 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vps6"] Jul 13 22:19:49.395915 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:19:49.395890 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8afbc8_b9ca_4732_8dea_1a1abe0713f3.slice/crio-56c3909a91cd530fa6a45f4f498a38f5f7307e4023aeb9c2d60a343d32e9e8b5 WatchSource:0}: Error finding container 56c3909a91cd530fa6a45f4f498a38f5f7307e4023aeb9c2d60a343d32e9e8b5: Status 404 returned error can't find the container with id 56c3909a91cd530fa6a45f4f498a38f5f7307e4023aeb9c2d60a343d32e9e8b5 Jul 13 22:19:49.772097 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:49.772061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" event={"ID":"9eceb5e4-9c93-49a4-bca5-c766902dc884","Type":"ContainerStarted","Data":"ed0f9113182e37db77110f5fd0ae8f345cc84280a4664ae2416a06c5c24e0630"} Jul 13 22:19:49.773309 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:49.773284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vps6" event={"ID":"9b8afbc8-b9ca-4732-8dea-1a1abe0713f3","Type":"ContainerStarted","Data":"56c3909a91cd530fa6a45f4f498a38f5f7307e4023aeb9c2d60a343d32e9e8b5"} Jul 13 22:19:51.784619 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:51.784584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" event={"ID":"9eceb5e4-9c93-49a4-bca5-c766902dc884","Type":"ContainerStarted","Data":"dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8"} Jul 13 22:19:51.785092 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:51.784629 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" podUID="9eceb5e4-9c93-49a4-bca5-c766902dc884" containerName="registry-server" containerID="cri-o://dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8" gracePeriod=2 Jul 13 22:19:51.787448 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:51.786473 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vps6" event={"ID":"9b8afbc8-b9ca-4732-8dea-1a1abe0713f3","Type":"ContainerStarted","Data":"84d0314d49813bf5a9ae015a2f332ba20171f1fc71650db956b4cabf4e424229"} Jul 13 22:19:51.804277 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:51.804233 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" podStartSLOduration=1.641077908 podStartE2EDuration="3.804218908s" totalImagesPullingTime="2.163141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:19:51.803582234 +0000 UTC m=+396.406858469" watchObservedRunningTime="2026-07-13 22:19:51.804218908 +0000 UTC m=+396.407495135" Jul 13 22:19:51.818076 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:51.818030 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7vps6" podStartSLOduration=2.214281499 podStartE2EDuration="3.818016357s" totalImagesPullingTime="1.603734858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:19:51.816002039 +0000 UTC m=+396.419278266" watchObservedRunningTime="2026-07-13 22:19:51.818016357 +0000 UTC m=+396.421292603" Jul 13 22:19:52.030898 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.030872 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" Jul 13 22:19:52.105712 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.105626 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7fhl\" (UniqueName: \"kubernetes.io/projected/9eceb5e4-9c93-49a4-bca5-c766902dc884-kube-api-access-d7fhl\") pod \"9eceb5e4-9c93-49a4-bca5-c766902dc884\" (UID: \"9eceb5e4-9c93-49a4-bca5-c766902dc884\") " Jul 13 22:19:52.107782 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.107754 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eceb5e4-9c93-49a4-bca5-c766902dc884-kube-api-access-d7fhl" (OuterVolumeSpecName: "kube-api-access-d7fhl") pod "9eceb5e4-9c93-49a4-bca5-c766902dc884" (UID: "9eceb5e4-9c93-49a4-bca5-c766902dc884"). InnerVolumeSpecName "kube-api-access-d7fhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:19:52.206620 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.206599 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7fhl\" (UniqueName: \"kubernetes.io/projected/9eceb5e4-9c93-49a4-bca5-c766902dc884-kube-api-access-d7fhl\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:19:52.792580 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.792548 2581 generic.go:356] "Generic (PLEG): container finished" podID="9eceb5e4-9c93-49a4-bca5-c766902dc884" containerID="dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8" exitCode=0 Jul 13 22:19:52.792936 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.792593 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" Jul 13 22:19:52.792936 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.792633 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" event={"ID":"9eceb5e4-9c93-49a4-bca5-c766902dc884","Type":"ContainerDied","Data":"dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8"} Jul 13 22:19:52.792936 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.792686 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rk8pc" event={"ID":"9eceb5e4-9c93-49a4-bca5-c766902dc884","Type":"ContainerDied","Data":"ed0f9113182e37db77110f5fd0ae8f345cc84280a4664ae2416a06c5c24e0630"} Jul 13 22:19:52.792936 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.792714 2581 scope.go:117] "RemoveContainer" containerID="dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8" Jul 13 22:19:52.802498 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.802481 2581 scope.go:117] "RemoveContainer" containerID="dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8" Jul 13 22:19:52.802726 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:19:52.802708 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8\": container with ID starting with dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8 not found: ID does not exist" containerID="dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8" Jul 13 22:19:52.802768 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.802735 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8"} err="failed to get container status \"dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8\": rpc error: code = NotFound desc = could not find container \"dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8\": container with ID starting with dd0ece4f51c46dd063d547c71177f41c4847249423e82c75d004104187437bb8 not found: ID does not exist" Jul 13 22:19:52.812717 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.812694 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rk8pc"] Jul 13 22:19:52.814405 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:52.814385 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rk8pc"] Jul 13 22:19:53.906900 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:53.906870 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eceb5e4-9c93-49a4-bca5-c766902dc884" path="/var/lib/kubelet/pods/9eceb5e4-9c93-49a4-bca5-c766902dc884/volumes" Jul 13 22:19:59.273662 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:59.273611 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-7vps6" Jul 13 22:19:59.274039 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:59.273709 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-7vps6" Jul 13 22:19:59.296393 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:59.296371 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-7vps6" Jul 13 22:19:59.849702 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:19:59.849679 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-7vps6" Jul 13 22:20:03.563607 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.563566 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn"] Jul 13 22:20:03.563971 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.563904 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eceb5e4-9c93-49a4-bca5-c766902dc884" containerName="registry-server" Jul 13 22:20:03.563971 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.563914 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eceb5e4-9c93-49a4-bca5-c766902dc884" containerName="registry-server" Jul 13 22:20:03.564047 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.563977 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eceb5e4-9c93-49a4-bca5-c766902dc884" containerName="registry-server" Jul 13 22:20:03.568330 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.568310 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.570430 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.570392 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hfx7c\"" Jul 13 22:20:03.574187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.574162 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn"] Jul 13 22:20:03.695229 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.695201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf4tt\" (UniqueName: \"kubernetes.io/projected/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-kube-api-access-sf4tt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.695381 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.695246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.695381 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.695265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.796498 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.796452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.796498 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.796499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.796709 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.796596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf4tt\" (UniqueName: \"kubernetes.io/projected/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-kube-api-access-sf4tt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.796826 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.796804 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.796890 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.796843 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.804560 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.804536 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf4tt\" (UniqueName: \"kubernetes.io/projected/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-kube-api-access-sf4tt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:03.879386 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:03.879324 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:04.004068 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.004046 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn"] Jul 13 22:20:04.005622 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:20:04.005599 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72f62ca_c6ba_4da5_bcc3_5e05211a82c6.slice/crio-c40e4302cfb0cc495a742ff4cd5790133a79f4007b0f051f2d7551558701a513 WatchSource:0}: Error finding container c40e4302cfb0cc495a742ff4cd5790133a79f4007b0f051f2d7551558701a513: Status 404 returned error can't find the container with id c40e4302cfb0cc495a742ff4cd5790133a79f4007b0f051f2d7551558701a513 Jul 13 22:20:04.358284 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.358255 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6"] Jul 13 22:20:04.361752 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.361736 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.369754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.369730 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6"] Jul 13 22:20:04.502840 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.502794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.502840 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.502852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w6x6\" (UniqueName: \"kubernetes.io/projected/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-kube-api-access-8w6x6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.503078 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.502957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.603580 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.603533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.603972 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.603608 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.603972 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.603645 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w6x6\" (UniqueName: \"kubernetes.io/projected/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-kube-api-access-8w6x6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.603972 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.603920 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.603972 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.603934 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.611000 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.610958 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w6x6\" (UniqueName: \"kubernetes.io/projected/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-kube-api-access-8w6x6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.671970 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.671934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:04.760882 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.760853 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm"] Jul 13 22:20:04.766268 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.766249 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:04.770460 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.770435 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm"] Jul 13 22:20:04.813226 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.813177 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6"] Jul 13 22:20:04.815566 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:20:04.815526 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c7970c_23c4_4088_8e8d_97e5f4f03f4a.slice/crio-07338e5a8c5b1406429893102d24aff6381345b267e17673ee6b9569c7bd9b50 WatchSource:0}: Error finding container 07338e5a8c5b1406429893102d24aff6381345b267e17673ee6b9569c7bd9b50: Status 404 returned error can't find the container with id 07338e5a8c5b1406429893102d24aff6381345b267e17673ee6b9569c7bd9b50 Jul 13 22:20:04.859485 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.859451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" event={"ID":"51c7970c-23c4-4088-8e8d-97e5f4f03f4a","Type":"ContainerStarted","Data":"07338e5a8c5b1406429893102d24aff6381345b267e17673ee6b9569c7bd9b50"} Jul 13 22:20:04.862097 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.862015 2581 generic.go:356] "Generic (PLEG): container finished" podID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerID="e4930dd8272983c419d8e90cf204b450344e08ea2dd87205354c290cb27ef348" exitCode=0 Jul 13 22:20:04.862097 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.862064 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" event={"ID":"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6","Type":"ContainerDied","Data":"e4930dd8272983c419d8e90cf204b450344e08ea2dd87205354c290cb27ef348"} Jul 13 22:20:04.862275 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.862152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" event={"ID":"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6","Type":"ContainerStarted","Data":"c40e4302cfb0cc495a742ff4cd5790133a79f4007b0f051f2d7551558701a513"} Jul 13 22:20:04.906369 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.906306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:04.906369 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.906348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft2g7\" (UniqueName: \"kubernetes.io/projected/9534e13b-85a8-4521-82ce-2cae5bf46356-kube-api-access-ft2g7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:04.906666 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:04.906457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:05.007411 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.007379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:05.007589 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.007471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:05.007589 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.007488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft2g7\" (UniqueName: \"kubernetes.io/projected/9534e13b-85a8-4521-82ce-2cae5bf46356-kube-api-access-ft2g7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:05.007928 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.007905 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:05.007970 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.007915 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:05.015276 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.015247 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft2g7\" (UniqueName: \"kubernetes.io/projected/9534e13b-85a8-4521-82ce-2cae5bf46356-kube-api-access-ft2g7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:05.078600 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.078566 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:05.162370 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.162336 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f"] Jul 13 22:20:05.167660 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.167633 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.174527 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.174494 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f"] Jul 13 22:20:05.217579 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.217550 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm"] Jul 13 22:20:05.219593 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:20:05.219557 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9534e13b_85a8_4521_82ce_2cae5bf46356.slice/crio-4b2495d795998cbdb4d23c8febc0e89e407db63fbd1df15340b282dec9568d6b WatchSource:0}: Error finding container 4b2495d795998cbdb4d23c8febc0e89e407db63fbd1df15340b282dec9568d6b: Status 404 returned error can't find the container with id 4b2495d795998cbdb4d23c8febc0e89e407db63fbd1df15340b282dec9568d6b Jul 13 22:20:05.309433 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.309381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.309433 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.309438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpvtr\" (UniqueName: \"kubernetes.io/projected/8abb5381-d256-41bf-891f-1db5fe79d884-kube-api-access-dpvtr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.309660 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.309578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.410314 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.410215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.410314 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.410282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.410314 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.410300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpvtr\" (UniqueName: \"kubernetes.io/projected/8abb5381-d256-41bf-891f-1db5fe79d884-kube-api-access-dpvtr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.410723 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.410700 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.410784 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.410704 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.418619 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.418586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpvtr\" (UniqueName: \"kubernetes.io/projected/8abb5381-d256-41bf-891f-1db5fe79d884-kube-api-access-dpvtr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.480027 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.479998 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:05.651056 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.651031 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f"] Jul 13 22:20:05.653728 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:20:05.653693 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8abb5381_d256_41bf_891f_1db5fe79d884.slice/crio-30590618ab4809368718b549f30efa64d74ea9e9776ed28cbc0a10c36ddd08db WatchSource:0}: Error finding container 30590618ab4809368718b549f30efa64d74ea9e9776ed28cbc0a10c36ddd08db: Status 404 returned error can't find the container with id 30590618ab4809368718b549f30efa64d74ea9e9776ed28cbc0a10c36ddd08db Jul 13 22:20:05.869455 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.869401 2581 generic.go:356] "Generic (PLEG): container finished" podID="8abb5381-d256-41bf-891f-1db5fe79d884" containerID="de308c9e34c3ef09e17ac117b218d0676a67b66e22946a42c62fe5c2e840fd99" exitCode=0 Jul 13 22:20:05.869648 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.869490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" event={"ID":"8abb5381-d256-41bf-891f-1db5fe79d884","Type":"ContainerDied","Data":"de308c9e34c3ef09e17ac117b218d0676a67b66e22946a42c62fe5c2e840fd99"} Jul 13 22:20:05.869648 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.869548 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" event={"ID":"8abb5381-d256-41bf-891f-1db5fe79d884","Type":"ContainerStarted","Data":"30590618ab4809368718b549f30efa64d74ea9e9776ed28cbc0a10c36ddd08db"} Jul 13 22:20:05.871072 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.871049 2581 generic.go:356] "Generic (PLEG): container finished" podID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerID="f29f7622693ebe113b256aa805178bd2248a5ec9e0ba20b49c5c6e4ca7b04596" exitCode=0 Jul 13 22:20:05.871179 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.871128 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" event={"ID":"9534e13b-85a8-4521-82ce-2cae5bf46356","Type":"ContainerDied","Data":"f29f7622693ebe113b256aa805178bd2248a5ec9e0ba20b49c5c6e4ca7b04596"} Jul 13 22:20:05.871179 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.871171 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" event={"ID":"9534e13b-85a8-4521-82ce-2cae5bf46356","Type":"ContainerStarted","Data":"4b2495d795998cbdb4d23c8febc0e89e407db63fbd1df15340b282dec9568d6b"} Jul 13 22:20:05.872980 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.872957 2581 generic.go:356] "Generic (PLEG): container finished" podID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerID="26f248b7230f96a24a45e9a0dd26d185d005bc2cbee7c42cf5006dd6dcd85a48" exitCode=0 Jul 13 22:20:05.873082 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.873033 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" event={"ID":"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6","Type":"ContainerDied","Data":"26f248b7230f96a24a45e9a0dd26d185d005bc2cbee7c42cf5006dd6dcd85a48"} Jul 13 22:20:05.874785 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.874766 2581 generic.go:356] "Generic (PLEG): container finished" podID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerID="62a8a7ff728e17439b7d8b278b5adcee7af6c7f43f0a9c9dd5e6f00347f3604c" exitCode=0 Jul 13 22:20:05.874871 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:05.874791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" event={"ID":"51c7970c-23c4-4088-8e8d-97e5f4f03f4a","Type":"ContainerDied","Data":"62a8a7ff728e17439b7d8b278b5adcee7af6c7f43f0a9c9dd5e6f00347f3604c"} Jul 13 22:20:06.883954 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:06.883919 2581 generic.go:356] "Generic (PLEG): container finished" podID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerID="431c255d40da88bed4286f47c9c2d88d379b9997bfbacded9b74857e021c34ad" exitCode=0 Jul 13 22:20:06.884354 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:06.883999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" event={"ID":"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6","Type":"ContainerDied","Data":"431c255d40da88bed4286f47c9c2d88d379b9997bfbacded9b74857e021c34ad"} Jul 13 22:20:07.892455 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:07.892406 2581 generic.go:356] "Generic (PLEG): container finished" podID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerID="e06a9fad06514a72794b042cd14756f5678763a5004f6854e76f52109a33ea5b" exitCode=0 Jul 13 22:20:07.892852 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:07.892457 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" event={"ID":"51c7970c-23c4-4088-8e8d-97e5f4f03f4a","Type":"ContainerDied","Data":"e06a9fad06514a72794b042cd14756f5678763a5004f6854e76f52109a33ea5b"} Jul 13 22:20:07.894385 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:07.894363 2581 generic.go:356] "Generic (PLEG): container finished" podID="8abb5381-d256-41bf-891f-1db5fe79d884" containerID="50f1bc3cb6b1d9d3150eda2dd2770e8efac8c8a2f0b95a67571247e8d8729dd2" exitCode=0 Jul 13 22:20:07.894533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:07.894459 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" event={"ID":"8abb5381-d256-41bf-891f-1db5fe79d884","Type":"ContainerDied","Data":"50f1bc3cb6b1d9d3150eda2dd2770e8efac8c8a2f0b95a67571247e8d8729dd2"} Jul 13 22:20:07.896312 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:07.896285 2581 generic.go:356] "Generic (PLEG): container finished" podID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerID="a74d6ee87ea6561f17c8e10d45e74c2ff04017f4176ee391cf0c49a6535de144" exitCode=0 Jul 13 22:20:07.896406 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:07.896347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" event={"ID":"9534e13b-85a8-4521-82ce-2cae5bf46356","Type":"ContainerDied","Data":"a74d6ee87ea6561f17c8e10d45e74c2ff04017f4176ee391cf0c49a6535de144"} Jul 13 22:20:08.058294 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.058267 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:08.134997 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.134967 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-bundle\") pod \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " Jul 13 22:20:08.135182 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.135043 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf4tt\" (UniqueName: \"kubernetes.io/projected/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-kube-api-access-sf4tt\") pod \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " Jul 13 22:20:08.135182 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.135070 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-util\") pod \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\" (UID: \"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6\") " Jul 13 22:20:08.135716 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.135688 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-bundle" (OuterVolumeSpecName: "bundle") pod "b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" (UID: "b72f62ca-c6ba-4da5-bcc3-5e05211a82c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:08.137051 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.137029 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-kube-api-access-sf4tt" (OuterVolumeSpecName: "kube-api-access-sf4tt") pod "b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" (UID: "b72f62ca-c6ba-4da5-bcc3-5e05211a82c6"). InnerVolumeSpecName "kube-api-access-sf4tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:20:08.140803 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.140745 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-util" (OuterVolumeSpecName: "util") pod "b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" (UID: "b72f62ca-c6ba-4da5-bcc3-5e05211a82c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:08.235781 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.235744 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:08.235781 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.235775 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf4tt\" (UniqueName: \"kubernetes.io/projected/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-kube-api-access-sf4tt\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:08.235781 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.235784 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b72f62ca-c6ba-4da5-bcc3-5e05211a82c6-util\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:08.903327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.903292 2581 generic.go:356] "Generic (PLEG): container finished" podID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerID="fb94f16d8d666c5900a8e7c43a6229cfc5f2f477b09c487f30346fb8f488334c" exitCode=0 Jul 13 22:20:08.903777 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.903373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" event={"ID":"51c7970c-23c4-4088-8e8d-97e5f4f03f4a","Type":"ContainerDied","Data":"fb94f16d8d666c5900a8e7c43a6229cfc5f2f477b09c487f30346fb8f488334c"} Jul 13 22:20:08.905344 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.905324 2581 generic.go:356] "Generic (PLEG): container finished" podID="8abb5381-d256-41bf-891f-1db5fe79d884" containerID="bcce57631496ece575fba73b92fd9cb38e807e5597f789f991f2ff24d5faa189" exitCode=0 Jul 13 22:20:08.905472 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.905395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" event={"ID":"8abb5381-d256-41bf-891f-1db5fe79d884","Type":"ContainerDied","Data":"bcce57631496ece575fba73b92fd9cb38e807e5597f789f991f2ff24d5faa189"} Jul 13 22:20:08.907460 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.907438 2581 generic.go:356] "Generic (PLEG): container finished" podID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerID="790a40c980af540612e8d36d15d09a8ce9450cc866b8b4f0c483e2808e0da90d" exitCode=0 Jul 13 22:20:08.907547 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.907515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" event={"ID":"9534e13b-85a8-4521-82ce-2cae5bf46356","Type":"ContainerDied","Data":"790a40c980af540612e8d36d15d09a8ce9450cc866b8b4f0c483e2808e0da90d"} Jul 13 22:20:08.909284 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.909262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" event={"ID":"b72f62ca-c6ba-4da5-bcc3-5e05211a82c6","Type":"ContainerDied","Data":"c40e4302cfb0cc495a742ff4cd5790133a79f4007b0f051f2d7551558701a513"} Jul 13 22:20:08.909284 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.909279 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn" Jul 13 22:20:08.909399 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:08.909297 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c40e4302cfb0cc495a742ff4cd5790133a79f4007b0f051f2d7551558701a513" Jul 13 22:20:10.080058 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.080021 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:10.099786 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.099759 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:10.122687 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.122656 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:10.152346 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.152315 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-util\") pod \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " Jul 13 22:20:10.152579 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.152384 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-bundle\") pod \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " Jul 13 22:20:10.152579 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.152412 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w6x6\" (UniqueName: \"kubernetes.io/projected/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-kube-api-access-8w6x6\") pod \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\" (UID: \"51c7970c-23c4-4088-8e8d-97e5f4f03f4a\") " Jul 13 22:20:10.152985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.152956 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-bundle" (OuterVolumeSpecName: "bundle") pod "51c7970c-23c4-4088-8e8d-97e5f4f03f4a" (UID: "51c7970c-23c4-4088-8e8d-97e5f4f03f4a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:10.155041 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.155009 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-kube-api-access-8w6x6" (OuterVolumeSpecName: "kube-api-access-8w6x6") pod "51c7970c-23c4-4088-8e8d-97e5f4f03f4a" (UID: "51c7970c-23c4-4088-8e8d-97e5f4f03f4a"). InnerVolumeSpecName "kube-api-access-8w6x6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:20:10.167742 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.167654 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-util" (OuterVolumeSpecName: "util") pod "51c7970c-23c4-4088-8e8d-97e5f4f03f4a" (UID: "51c7970c-23c4-4088-8e8d-97e5f4f03f4a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:10.253190 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.253150 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-util\") pod \"8abb5381-d256-41bf-891f-1db5fe79d884\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " Jul 13 22:20:10.253389 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.253212 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpvtr\" (UniqueName: \"kubernetes.io/projected/8abb5381-d256-41bf-891f-1db5fe79d884-kube-api-access-dpvtr\") pod \"8abb5381-d256-41bf-891f-1db5fe79d884\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " Jul 13 22:20:10.253389 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.253240 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-util\") pod \"9534e13b-85a8-4521-82ce-2cae5bf46356\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " Jul 13 22:20:10.253389 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.253260 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft2g7\" (UniqueName: \"kubernetes.io/projected/9534e13b-85a8-4521-82ce-2cae5bf46356-kube-api-access-ft2g7\") pod \"9534e13b-85a8-4521-82ce-2cae5bf46356\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " Jul 13 22:20:10.253389 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.253308 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-bundle\") pod \"9534e13b-85a8-4521-82ce-2cae5bf46356\" (UID: \"9534e13b-85a8-4521-82ce-2cae5bf46356\") " Jul 13 22:20:10.253389 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.253357 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-bundle\") pod \"8abb5381-d256-41bf-891f-1db5fe79d884\" (UID: \"8abb5381-d256-41bf-891f-1db5fe79d884\") " Jul 13 22:20:10.262197 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.254121 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-util\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:10.262197 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.254163 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:10.262197 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.254180 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w6x6\" (UniqueName: \"kubernetes.io/projected/51c7970c-23c4-4088-8e8d-97e5f4f03f4a-kube-api-access-8w6x6\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:10.262197 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.254206 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-bundle" (OuterVolumeSpecName: "bundle") pod "9534e13b-85a8-4521-82ce-2cae5bf46356" (UID: "9534e13b-85a8-4521-82ce-2cae5bf46356"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:10.262197 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.254377 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-bundle" (OuterVolumeSpecName: "bundle") pod "8abb5381-d256-41bf-891f-1db5fe79d884" (UID: "8abb5381-d256-41bf-891f-1db5fe79d884"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:10.262197 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.261745 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-util" (OuterVolumeSpecName: "util") pod "8abb5381-d256-41bf-891f-1db5fe79d884" (UID: "8abb5381-d256-41bf-891f-1db5fe79d884"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:10.262657 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.262581 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-util" (OuterVolumeSpecName: "util") pod "9534e13b-85a8-4521-82ce-2cae5bf46356" (UID: "9534e13b-85a8-4521-82ce-2cae5bf46356"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:10.262904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.262855 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9534e13b-85a8-4521-82ce-2cae5bf46356-kube-api-access-ft2g7" (OuterVolumeSpecName: "kube-api-access-ft2g7") pod "9534e13b-85a8-4521-82ce-2cae5bf46356" (UID: "9534e13b-85a8-4521-82ce-2cae5bf46356"). InnerVolumeSpecName "kube-api-access-ft2g7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:20:10.264510 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.264488 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8abb5381-d256-41bf-891f-1db5fe79d884-kube-api-access-dpvtr" (OuterVolumeSpecName: "kube-api-access-dpvtr") pod "8abb5381-d256-41bf-891f-1db5fe79d884" (UID: "8abb5381-d256-41bf-891f-1db5fe79d884"). InnerVolumeSpecName "kube-api-access-dpvtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:20:10.354643 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.354598 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:10.354643 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.354640 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8abb5381-d256-41bf-891f-1db5fe79d884-util\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:10.354643 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.354652 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpvtr\" (UniqueName: \"kubernetes.io/projected/8abb5381-d256-41bf-891f-1db5fe79d884-kube-api-access-dpvtr\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:10.354851 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.354663 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-util\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:10.354851 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.354671 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft2g7\" (UniqueName: \"kubernetes.io/projected/9534e13b-85a8-4521-82ce-2cae5bf46356-kube-api-access-ft2g7\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:10.354851 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.354679 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9534e13b-85a8-4521-82ce-2cae5bf46356-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:10.921435 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.921395 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" Jul 13 22:20:10.921627 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.921392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6" event={"ID":"51c7970c-23c4-4088-8e8d-97e5f4f03f4a","Type":"ContainerDied","Data":"07338e5a8c5b1406429893102d24aff6381345b267e17673ee6b9569c7bd9b50"} Jul 13 22:20:10.921627 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.921554 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07338e5a8c5b1406429893102d24aff6381345b267e17673ee6b9569c7bd9b50" Jul 13 22:20:10.923346 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.923322 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" event={"ID":"8abb5381-d256-41bf-891f-1db5fe79d884","Type":"ContainerDied","Data":"30590618ab4809368718b549f30efa64d74ea9e9776ed28cbc0a10c36ddd08db"} Jul 13 22:20:10.923346 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.923334 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f" Jul 13 22:20:10.923541 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.923365 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30590618ab4809368718b549f30efa64d74ea9e9776ed28cbc0a10c36ddd08db" Jul 13 22:20:10.925501 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.925483 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" Jul 13 22:20:10.925589 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.925500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm" event={"ID":"9534e13b-85a8-4521-82ce-2cae5bf46356","Type":"ContainerDied","Data":"4b2495d795998cbdb4d23c8febc0e89e407db63fbd1df15340b282dec9568d6b"} Jul 13 22:20:10.925589 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:10.925542 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b2495d795998cbdb4d23c8febc0e89e407db63fbd1df15340b282dec9568d6b" Jul 13 22:20:17.513966 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:17.513928 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.158046 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj"] Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159100 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerName="pull" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159122 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerName="pull" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159150 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159160 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159181 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159190 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159201 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerName="pull" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159224 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerName="pull" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159252 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159260 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159280 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerName="util" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159303 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerName="util" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159330 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerName="util" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159338 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerName="util" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159347 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abb5381-d256-41bf-891f-1db5fe79d884" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159354 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abb5381-d256-41bf-891f-1db5fe79d884" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159383 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abb5381-d256-41bf-891f-1db5fe79d884" containerName="util" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159393 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abb5381-d256-41bf-891f-1db5fe79d884" containerName="util" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159414 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abb5381-d256-41bf-891f-1db5fe79d884" containerName="pull" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159464 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abb5381-d256-41bf-891f-1db5fe79d884" containerName="pull" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159479 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerName="pull" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159486 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerName="pull" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159507 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerName="util" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159531 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerName="util" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159732 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abb5381-d256-41bf-891f-1db5fe79d884" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159762 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c7970c-23c4-4088-8e8d-97e5f4f03f4a" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159780 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b72f62ca-c6ba-4da5-bcc3-5e05211a82c6" containerName="extract" Jul 13 22:20:20.161440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.159793 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9534e13b-85a8-4521-82ce-2cae5bf46356" containerName="extract" Jul 13 22:20:20.167179 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.167154 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:20.174372 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.174043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rnqfc\"" Jul 13 22:20:20.176518 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.176491 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj"] Jul 13 22:20:20.341485 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.341457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7c9z\" (UniqueName: \"kubernetes.io/projected/b82a15c4-782e-4eed-a233-0acc1042269c-kube-api-access-d7c9z\") pod \"limitador-operator-controller-manager-859d7b78bd-twhhj\" (UID: \"b82a15c4-782e-4eed-a233-0acc1042269c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:20.442793 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.442714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7c9z\" (UniqueName: \"kubernetes.io/projected/b82a15c4-782e-4eed-a233-0acc1042269c-kube-api-access-d7c9z\") pod \"limitador-operator-controller-manager-859d7b78bd-twhhj\" (UID: \"b82a15c4-782e-4eed-a233-0acc1042269c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:20.451749 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.451725 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7c9z\" (UniqueName: \"kubernetes.io/projected/b82a15c4-782e-4eed-a233-0acc1042269c-kube-api-access-d7c9z\") pod \"limitador-operator-controller-manager-859d7b78bd-twhhj\" (UID: \"b82a15c4-782e-4eed-a233-0acc1042269c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:20.478561 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.478530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:20.613957 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.613933 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj"] Jul 13 22:20:20.615357 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:20:20.615329 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82a15c4_782e_4eed_a233_0acc1042269c.slice/crio-eb9b2811153b6dbac890c091a9370fb01f61abcf59eaeadd87cbbe7dc748b58a WatchSource:0}: Error finding container eb9b2811153b6dbac890c091a9370fb01f61abcf59eaeadd87cbbe7dc748b58a: Status 404 returned error can't find the container with id eb9b2811153b6dbac890c091a9370fb01f61abcf59eaeadd87cbbe7dc748b58a Jul 13 22:20:20.964130 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.964101 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:20.978836 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:20.978806 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" event={"ID":"b82a15c4-782e-4eed-a233-0acc1042269c","Type":"ContainerStarted","Data":"eb9b2811153b6dbac890c091a9370fb01f61abcf59eaeadd87cbbe7dc748b58a"} Jul 13 22:20:21.513914 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:21.513879 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:22.990261 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:22.990181 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" event={"ID":"b82a15c4-782e-4eed-a233-0acc1042269c","Type":"ContainerStarted","Data":"8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0"} Jul 13 22:20:22.990679 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:22.990321 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:23.007138 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:23.007096 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" podStartSLOduration=0.9975582 podStartE2EDuration="3.007081701s" totalImagesPullingTime="2.009523501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:20:23.006002071 +0000 UTC m=+427.609278299" watchObservedRunningTime="2026-07-13 22:20:23.007081701 +0000 UTC m=+427.610358365" Jul 13 22:20:24.109358 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.109320 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb"] Jul 13 22:20:24.113116 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.113095 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" Jul 13 22:20:24.115035 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.115015 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-24fbp\"" Jul 13 22:20:24.122802 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.122773 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb"] Jul 13 22:20:24.174374 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.174335 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9rfx\" (UniqueName: \"kubernetes.io/projected/d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea-kube-api-access-v9rfx\") pod \"authorino-operator-75cc8d5cb7-n8hmb\" (UID: \"d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" Jul 13 22:20:24.275594 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.275558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9rfx\" (UniqueName: \"kubernetes.io/projected/d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea-kube-api-access-v9rfx\") pod \"authorino-operator-75cc8d5cb7-n8hmb\" (UID: \"d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" Jul 13 22:20:24.283272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.283245 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9rfx\" (UniqueName: \"kubernetes.io/projected/d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea-kube-api-access-v9rfx\") pod \"authorino-operator-75cc8d5cb7-n8hmb\" (UID: \"d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" Jul 13 22:20:24.423568 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.423497 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" Jul 13 22:20:24.553544 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.553521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb"] Jul 13 22:20:24.554552 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:20:24.554529 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4df5da7_5318_4339_a8ec_5dcdbbeeb3ea.slice/crio-678a4f09c7eb54f6ecc83a64f4ed29d11a159a31930d76d0022b6230c4abd6c0 WatchSource:0}: Error finding container 678a4f09c7eb54f6ecc83a64f4ed29d11a159a31930d76d0022b6230c4abd6c0: Status 404 returned error can't find the container with id 678a4f09c7eb54f6ecc83a64f4ed29d11a159a31930d76d0022b6230c4abd6c0 Jul 13 22:20:24.766955 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:24.766919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:25.001042 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:25.001011 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" event={"ID":"d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea","Type":"ContainerStarted","Data":"678a4f09c7eb54f6ecc83a64f4ed29d11a159a31930d76d0022b6230c4abd6c0"} Jul 13 22:20:25.133745 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:25.133632 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:26.746623 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:26.746570 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:27.013166 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.013131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" event={"ID":"d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea","Type":"ContainerStarted","Data":"849975d380e3816bfb78abf1137f2f394305c8cd460cb8beb01d574256eda30f"} Jul 13 22:20:27.013293 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.013215 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" Jul 13 22:20:27.029675 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.029621 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" podStartSLOduration=0.68519468 podStartE2EDuration="3.029606666s" totalImagesPullingTime="2.344411986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:20:27.027874249 +0000 UTC m=+431.631150476" watchObservedRunningTime="2026-07-13 22:20:27.029606666 +0000 UTC m=+431.632882893" Jul 13 22:20:27.333698 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.333617 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk"] Jul 13 22:20:27.337029 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.337013 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" Jul 13 22:20:27.339213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.339187 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2lrrx\"" Jul 13 22:20:27.339651 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.339634 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 13 22:20:27.349123 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.349101 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk"] Jul 13 22:20:27.401167 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.401140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq72w\" (UniqueName: \"kubernetes.io/projected/5bc092a1-70a2-46ae-b65f-2842676b26c5-kube-api-access-tq72w\") pod \"dns-operator-controller-manager-864dd78c4c-vqhsk\" (UID: \"5bc092a1-70a2-46ae-b65f-2842676b26c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" Jul 13 22:20:27.502201 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.502173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq72w\" (UniqueName: \"kubernetes.io/projected/5bc092a1-70a2-46ae-b65f-2842676b26c5-kube-api-access-tq72w\") pod \"dns-operator-controller-manager-864dd78c4c-vqhsk\" (UID: \"5bc092a1-70a2-46ae-b65f-2842676b26c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" Jul 13 22:20:27.515334 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.515306 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq72w\" (UniqueName: \"kubernetes.io/projected/5bc092a1-70a2-46ae-b65f-2842676b26c5-kube-api-access-tq72w\") pod \"dns-operator-controller-manager-864dd78c4c-vqhsk\" (UID: \"5bc092a1-70a2-46ae-b65f-2842676b26c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" Jul 13 22:20:27.648797 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.648725 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" Jul 13 22:20:27.785728 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:27.785705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk"] Jul 13 22:20:27.787253 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:20:27.787227 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc092a1_70a2_46ae_b65f_2842676b26c5.slice/crio-a174aed349477297c3ca3fd036fade247d58e3cc8cdd8c68a79b562ab4ce9970 WatchSource:0}: Error finding container a174aed349477297c3ca3fd036fade247d58e3cc8cdd8c68a79b562ab4ce9970: Status 404 returned error can't find the container with id a174aed349477297c3ca3fd036fade247d58e3cc8cdd8c68a79b562ab4ce9970 Jul 13 22:20:28.019097 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:28.019068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" event={"ID":"5bc092a1-70a2-46ae-b65f-2842676b26c5","Type":"ContainerStarted","Data":"a174aed349477297c3ca3fd036fade247d58e3cc8cdd8c68a79b562ab4ce9970"} Jul 13 22:20:28.114008 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:28.113979 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:28.246174 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:28.246139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:29.750794 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:29.750745 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:31.043889 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:31.043850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" event={"ID":"5bc092a1-70a2-46ae-b65f-2842676b26c5","Type":"ContainerStarted","Data":"f1e453eb7c91fb2eb4ed99c0b430db3b2b709d410c2aee076651e8c6aba29208"} Jul 13 22:20:31.044245 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:31.043935 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" Jul 13 22:20:31.062016 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:31.061976 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" podStartSLOduration=1.515593456 podStartE2EDuration="4.061962901s" totalImagesPullingTime="2.546369445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:20:31.059560306 +0000 UTC m=+435.662836529" watchObservedRunningTime="2026-07-13 22:20:31.061962901 +0000 UTC m=+435.665239127" Jul 13 22:20:31.920847 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:31.920807 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w"] Jul 13 22:20:31.924155 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:31.924139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:31.926481 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:31.926461 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-94xzr\"" Jul 13 22:20:31.936598 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:31.936571 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w"] Jul 13 22:20:31.941457 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:31.941434 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbnvv\" (UniqueName: \"kubernetes.io/projected/4c09970b-6429-4885-92c7-d76b7407a091-kube-api-access-xbnvv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" (UID: \"4c09970b-6429-4885-92c7-d76b7407a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:31.941562 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:31.941477 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c09970b-6429-4885-92c7-d76b7407a091-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" (UID: \"4c09970b-6429-4885-92c7-d76b7407a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:32.042782 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:32.042750 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbnvv\" (UniqueName: \"kubernetes.io/projected/4c09970b-6429-4885-92c7-d76b7407a091-kube-api-access-xbnvv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" (UID: \"4c09970b-6429-4885-92c7-d76b7407a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:32.042782 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:32.042785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c09970b-6429-4885-92c7-d76b7407a091-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" (UID: \"4c09970b-6429-4885-92c7-d76b7407a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:32.043116 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:32.043099 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c09970b-6429-4885-92c7-d76b7407a091-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" (UID: \"4c09970b-6429-4885-92c7-d76b7407a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:32.050344 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:32.050319 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbnvv\" (UniqueName: \"kubernetes.io/projected/4c09970b-6429-4885-92c7-d76b7407a091-kube-api-access-xbnvv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" (UID: \"4c09970b-6429-4885-92c7-d76b7407a091\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:32.233746 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:32.233669 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:32.366020 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:32.365996 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w"] Jul 13 22:20:32.368971 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:20:32.368941 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c09970b_6429_4885_92c7_d76b7407a091.slice/crio-a9e873bc7e8b404a073f12c55bf29727c852ba1508248e23f701e71151216b58 WatchSource:0}: Error finding container a9e873bc7e8b404a073f12c55bf29727c852ba1508248e23f701e71151216b58: Status 404 returned error can't find the container with id a9e873bc7e8b404a073f12c55bf29727c852ba1508248e23f701e71151216b58 Jul 13 22:20:32.922831 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:32.922763 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:33.023534 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:33.023499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:33.056168 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:33.056139 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" event={"ID":"4c09970b-6429-4885-92c7-d76b7407a091","Type":"ContainerStarted","Data":"a9e873bc7e8b404a073f12c55bf29727c852ba1508248e23f701e71151216b58"} Jul 13 22:20:33.997518 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:33.997486 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:38.022447 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:38.022342 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n8hmb" Jul 13 22:20:38.325123 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:38.325025 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:38.425596 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:38.425560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:38.739981 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:38.739928 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:38.840104 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:38.840072 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:39.094891 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:39.094854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" event={"ID":"4c09970b-6429-4885-92c7-d76b7407a091","Type":"ContainerStarted","Data":"23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f"} Jul 13 22:20:39.095267 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:39.094948 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:39.119323 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:39.119258 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" podStartSLOduration=1.885710269 podStartE2EDuration="8.119242811s" totalImagesPullingTime="6.233532542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:20:39.116708127 +0000 UTC m=+443.719984368" watchObservedRunningTime="2026-07-13 22:20:39.119242811 +0000 UTC m=+443.722519039" Jul 13 22:20:41.365397 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.365353 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4"] Jul 13 22:20:41.370495 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.370470 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:41.372783 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.372755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 13 22:20:41.372975 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.372933 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hfx7c\"" Jul 13 22:20:41.373557 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.373511 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 13 22:20:41.374557 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.374532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:41.375772 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.375750 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4"] Jul 13 22:20:41.424119 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.424097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a2e960f6-ac9d-4697-b976-c66a2a34b91b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:41.424251 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.424144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e960f6-ac9d-4697-b976-c66a2a34b91b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:41.424251 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.424178 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lzmj\" (UniqueName: \"kubernetes.io/projected/a2e960f6-ac9d-4697-b976-c66a2a34b91b-kube-api-access-4lzmj\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:41.525408 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.525370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a2e960f6-ac9d-4697-b976-c66a2a34b91b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:41.525576 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.525445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e960f6-ac9d-4697-b976-c66a2a34b91b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:41.525576 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.525483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lzmj\" (UniqueName: \"kubernetes.io/projected/a2e960f6-ac9d-4697-b976-c66a2a34b91b-kube-api-access-4lzmj\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:41.525658 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:41.525579 2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 13 22:20:41.531480 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:41.525868 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e960f6-ac9d-4697-b976-c66a2a34b91b-plugin-serving-cert podName:a2e960f6-ac9d-4697-b976-c66a2a34b91b nodeName:}" failed. No retries permitted until 2026-07-13 22:20:42.025740109 +0000 UTC m=+446.629016318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a2e960f6-ac9d-4697-b976-c66a2a34b91b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-jjlv4" (UID: "a2e960f6-ac9d-4697-b976-c66a2a34b91b") : secret "plugin-serving-cert" not found Jul 13 22:20:41.531480 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.526617 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a2e960f6-ac9d-4697-b976-c66a2a34b91b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:41.536347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.536326 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lzmj\" (UniqueName: \"kubernetes.io/projected/a2e960f6-ac9d-4697-b976-c66a2a34b91b-kube-api-access-4lzmj\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:41.595015 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.594977 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:41.722812 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.722747 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:41.823213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:41.823175 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:42.029613 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:42.029588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e960f6-ac9d-4697-b976-c66a2a34b91b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:42.031802 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:42.031781 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2e960f6-ac9d-4697-b976-c66a2a34b91b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jjlv4\" (UID: \"a2e960f6-ac9d-4697-b976-c66a2a34b91b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:42.052404 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:42.052380 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vqhsk" Jul 13 22:20:42.280808 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:42.280730 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" Jul 13 22:20:42.420513 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:42.420487 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4"] Jul 13 22:20:42.425549 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:20:42.425515 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2e960f6_ac9d_4697_b976_c66a2a34b91b.slice/crio-3f20d86b8bc94467f33a9066b9f4f054e34f290781015397a72edef206f95085 WatchSource:0}: Error finding container 3f20d86b8bc94467f33a9066b9f4f054e34f290781015397a72edef206f95085: Status 404 returned error can't find the container with id 3f20d86b8bc94467f33a9066b9f4f054e34f290781015397a72edef206f95085 Jul 13 22:20:42.590640 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:42.590567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:42.702472 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:42.702343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:43.116948 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:43.116918 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" event={"ID":"a2e960f6-ac9d-4697-b976-c66a2a34b91b","Type":"ContainerStarted","Data":"3f20d86b8bc94467f33a9066b9f4f054e34f290781015397a72edef206f95085"} Jul 13 22:20:44.387015 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:44.386978 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:44.440997 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:44.440965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:45.911066 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:45.910989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:46.010207 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:46.010165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:50.102783 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:50.102753 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:51.765732 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.765701 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w"] Jul 13 22:20:51.766303 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.765928 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" podUID="4c09970b-6429-4885-92c7-d76b7407a091" containerName="manager" containerID="cri-o://23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f" gracePeriod=2 Jul 13 22:20:51.778674 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.778643 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w"] Jul 13 22:20:51.781477 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:51.781401 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4c09970b-6429-4885-92c7-d76b7407a091\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-lw48w\": pods \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:51.790563 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.790537 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4"] Jul 13 22:20:51.790902 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.790891 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c09970b-6429-4885-92c7-d76b7407a091" containerName="manager" Jul 13 22:20:51.790945 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.790904 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c09970b-6429-4885-92c7-d76b7407a091" containerName="manager" Jul 13 22:20:51.790987 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.790965 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c09970b-6429-4885-92c7-d76b7407a091" containerName="manager" Jul 13 22:20:51.793968 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.793950 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:20:51.795221 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.795201 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj"] Jul 13 22:20:51.795444 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.795398 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" podUID="b82a15c4-782e-4eed-a233-0acc1042269c" containerName="manager" containerID="cri-o://8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0" gracePeriod=2 Jul 13 22:20:51.796593 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:51.796530 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" podUID="4c09970b-6429-4885-92c7-d76b7407a091" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:51.810997 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.810972 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj"] Jul 13 22:20:51.818773 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.815702 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4"] Jul 13 22:20:51.829389 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.829161 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv"] Jul 13 22:20:51.829943 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.829723 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82a15c4-782e-4eed-a233-0acc1042269c" containerName="manager" Jul 13 22:20:51.829943 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.829744 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82a15c4-782e-4eed-a233-0acc1042269c" containerName="manager" Jul 13 22:20:51.829943 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.829838 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82a15c4-782e-4eed-a233-0acc1042269c" containerName="manager" Jul 13 22:20:51.832390 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:51.832356 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" podUID="4c09970b-6429-4885-92c7-d76b7407a091" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:51.833220 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.833199 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" Jul 13 22:20:51.833778 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:51.833748 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twhhj\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" podUID="b82a15c4-782e-4eed-a233-0acc1042269c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:51.835711 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:51.835529 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lw48w\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" podUID="4c09970b-6429-4885-92c7-d76b7407a091" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:51.839958 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:51.838468 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-twhhj\" is forbidden: User \"system:node:ip-10-0-137-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-241.ec2.internal' and this object" podUID="b82a15c4-782e-4eed-a233-0acc1042269c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:51.841478 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.841343 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv"] Jul 13 22:20:51.926551 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.926514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xh5z4\" (UID: \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:20:51.926679 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.926599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6fr5\" (UniqueName: \"kubernetes.io/projected/41f85b25-311b-4158-a368-5cc24bcad099-kube-api-access-w6fr5\") pod \"limitador-operator-controller-manager-859d7b78bd-n6chv\" (UID: \"41f85b25-311b-4158-a368-5cc24bcad099\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" Jul 13 22:20:51.926747 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:51.926711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9dfv\" (UniqueName: \"kubernetes.io/projected/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-kube-api-access-j9dfv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xh5z4\" (UID: \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:20:52.027511 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.027479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xh5z4\" (UID: \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:20:52.027705 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.027673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6fr5\" (UniqueName: \"kubernetes.io/projected/41f85b25-311b-4158-a368-5cc24bcad099-kube-api-access-w6fr5\") pod \"limitador-operator-controller-manager-859d7b78bd-n6chv\" (UID: \"41f85b25-311b-4158-a368-5cc24bcad099\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" Jul 13 22:20:52.027843 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.027747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9dfv\" (UniqueName: \"kubernetes.io/projected/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-kube-api-access-j9dfv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xh5z4\" (UID: \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:20:52.027908 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.027869 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xh5z4\" (UID: \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:20:52.040932 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.040909 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9dfv\" (UniqueName: \"kubernetes.io/projected/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-kube-api-access-j9dfv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xh5z4\" (UID: \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:20:52.041036 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.040927 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6fr5\" (UniqueName: \"kubernetes.io/projected/41f85b25-311b-4158-a368-5cc24bcad099-kube-api-access-w6fr5\") pod \"limitador-operator-controller-manager-859d7b78bd-n6chv\" (UID: \"41f85b25-311b-4158-a368-5cc24bcad099\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" Jul 13 22:20:52.044955 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.044934 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:52.054685 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.054668 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:52.129041 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.129014 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbnvv\" (UniqueName: \"kubernetes.io/projected/4c09970b-6429-4885-92c7-d76b7407a091-kube-api-access-xbnvv\") pod \"4c09970b-6429-4885-92c7-d76b7407a091\" (UID: \"4c09970b-6429-4885-92c7-d76b7407a091\") " Jul 13 22:20:52.129171 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.129080 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c09970b-6429-4885-92c7-d76b7407a091-extensions-socket-volume\") pod \"4c09970b-6429-4885-92c7-d76b7407a091\" (UID: \"4c09970b-6429-4885-92c7-d76b7407a091\") " Jul 13 22:20:52.129171 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.129107 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7c9z\" (UniqueName: \"kubernetes.io/projected/b82a15c4-782e-4eed-a233-0acc1042269c-kube-api-access-d7c9z\") pod \"b82a15c4-782e-4eed-a233-0acc1042269c\" (UID: \"b82a15c4-782e-4eed-a233-0acc1042269c\") " Jul 13 22:20:52.129630 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.129607 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c09970b-6429-4885-92c7-d76b7407a091-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4c09970b-6429-4885-92c7-d76b7407a091" (UID: "4c09970b-6429-4885-92c7-d76b7407a091"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:20:52.131328 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.131305 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82a15c4-782e-4eed-a233-0acc1042269c-kube-api-access-d7c9z" (OuterVolumeSpecName: "kube-api-access-d7c9z") pod "b82a15c4-782e-4eed-a233-0acc1042269c" (UID: "b82a15c4-782e-4eed-a233-0acc1042269c"). InnerVolumeSpecName "kube-api-access-d7c9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:20:52.131440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.131350 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c09970b-6429-4885-92c7-d76b7407a091-kube-api-access-xbnvv" (OuterVolumeSpecName: "kube-api-access-xbnvv") pod "4c09970b-6429-4885-92c7-d76b7407a091" (UID: "4c09970b-6429-4885-92c7-d76b7407a091"). InnerVolumeSpecName "kube-api-access-xbnvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:20:52.177375 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.177337 2581 generic.go:356] "Generic (PLEG): container finished" podID="b82a15c4-782e-4eed-a233-0acc1042269c" containerID="8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0" exitCode=0 Jul 13 22:20:52.177522 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.177394 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-twhhj" Jul 13 22:20:52.177522 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.177456 2581 scope.go:117] "RemoveContainer" containerID="8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0" Jul 13 22:20:52.179220 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.179194 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c09970b-6429-4885-92c7-d76b7407a091" containerID="23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f" exitCode=0 Jul 13 22:20:52.179335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.179231 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lw48w" Jul 13 22:20:52.188976 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.188813 2581 scope.go:117] "RemoveContainer" containerID="8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0" Jul 13 22:20:52.189115 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:52.189093 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0\": container with ID starting with 8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0 not found: ID does not exist" containerID="8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0" Jul 13 22:20:52.189185 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.189127 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0"} err="failed to get container status \"8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0\": rpc error: code = NotFound desc = could not find container \"8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0\": container with ID starting with 8ebb7a481656e8c582a38a6cf56e00412d4d82376098e8b8f9f30eaed7559dd0 not found: ID does not exist" Jul 13 22:20:52.189185 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.189150 2581 scope.go:117] "RemoveContainer" containerID="23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f" Jul 13 22:20:52.193749 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.193728 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:20:52.199322 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.199308 2581 scope.go:117] "RemoveContainer" containerID="23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f" Jul 13 22:20:52.199577 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:20:52.199562 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f\": container with ID starting with 23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f not found: ID does not exist" containerID="23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f" Jul 13 22:20:52.199632 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.199582 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f"} err="failed to get container status \"23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f\": rpc error: code = NotFound desc = could not find container \"23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f\": container with ID starting with 23300fc8e28755fd9b053687355dfd057e18a16906fe9f738dfc030bab2b685f not found: ID does not exist" Jul 13 22:20:52.202736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.202722 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" Jul 13 22:20:52.230248 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.230215 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbnvv\" (UniqueName: \"kubernetes.io/projected/4c09970b-6429-4885-92c7-d76b7407a091-kube-api-access-xbnvv\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:52.230647 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.230243 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c09970b-6429-4885-92c7-d76b7407a091-extensions-socket-volume\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:52.230647 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.230280 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7c9z\" (UniqueName: \"kubernetes.io/projected/b82a15c4-782e-4eed-a233-0acc1042269c-kube-api-access-d7c9z\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:20:52.351338 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.351256 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4"] Jul 13 22:20:52.383315 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.383289 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv"] Jul 13 22:20:52.592755 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.592666 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:52.698365 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:52.698330 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:53.907984 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:53.907565 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c09970b-6429-4885-92c7-d76b7407a091" path="/var/lib/kubelet/pods/4c09970b-6429-4885-92c7-d76b7407a091/volumes" Jul 13 22:20:53.908585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:53.908021 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82a15c4-782e-4eed-a233-0acc1042269c" path="/var/lib/kubelet/pods/b82a15c4-782e-4eed-a233-0acc1042269c/volumes" Jul 13 22:20:56.745957 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:56.745923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:56.846591 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:56.846516 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:57.342714 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:57.342680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:20:57.443509 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:20:57.443479 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:01.146971 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:01.146927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:01.209956 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:01.209920 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:05.547137 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:05.547106 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:05.616022 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:05.615995 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:05.682813 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:05.682778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:06.177294 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:21:06.177252 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf4a9c3_f4f1_4fee_8d07_d13d05b63900.slice/crio-2be105267dcaa599dedf044f283d7c6b97945524efd25eb23c3a8994be043e5b WatchSource:0}: Error finding container 2be105267dcaa599dedf044f283d7c6b97945524efd25eb23c3a8994be043e5b: Status 404 returned error can't find the container with id 2be105267dcaa599dedf044f283d7c6b97945524efd25eb23c3a8994be043e5b Jul 13 22:21:06.178102 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:21:06.178069 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f85b25_311b_4158_a368_5cc24bcad099.slice/crio-2931729933a70d1cf5cef7b4412d898287a2f67a5c21426711b3dfefecb4ebc9 WatchSource:0}: Error finding container 2931729933a70d1cf5cef7b4412d898287a2f67a5c21426711b3dfefecb4ebc9: Status 404 returned error can't find the container with id 2931729933a70d1cf5cef7b4412d898287a2f67a5c21426711b3dfefecb4ebc9 Jul 13 22:21:06.278714 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:06.278684 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" event={"ID":"41f85b25-311b-4158-a368-5cc24bcad099","Type":"ContainerStarted","Data":"2931729933a70d1cf5cef7b4412d898287a2f67a5c21426711b3dfefecb4ebc9"} Jul 13 22:21:06.280681 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:06.280646 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" event={"ID":"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900","Type":"ContainerStarted","Data":"2be105267dcaa599dedf044f283d7c6b97945524efd25eb23c3a8994be043e5b"} Jul 13 22:21:07.287402 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:07.287365 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" event={"ID":"a2e960f6-ac9d-4697-b976-c66a2a34b91b","Type":"ContainerStarted","Data":"083e5acc01fd83a418d394a2c98e427552f5b720d973db5e3e922691c3d6a002"} Jul 13 22:21:07.288917 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:07.288892 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" event={"ID":"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900","Type":"ContainerStarted","Data":"92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f"} Jul 13 22:21:07.289008 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:07.288950 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:21:07.290597 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:07.290575 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" event={"ID":"41f85b25-311b-4158-a368-5cc24bcad099","Type":"ContainerStarted","Data":"6c7491eb40b417a92a1586a68c245108faf2e3b3950d802380e8a83666c69914"} Jul 13 22:21:07.290702 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:07.290692 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" Jul 13 22:21:07.303262 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:07.303223 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jjlv4" podStartSLOduration=2.491754245 podStartE2EDuration="26.303210615s" totalImagesPullingTime="23.81145637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:07.301466131 +0000 UTC m=+471.904742359" watchObservedRunningTime="2026-07-13 22:21:07.303210615 +0000 UTC m=+471.906486839" Jul 13 22:21:07.323001 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:07.322961 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" podStartSLOduration=16.322946699 podStartE2EDuration="16.322946699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:07.322189916 +0000 UTC m=+471.925466144" watchObservedRunningTime="2026-07-13 22:21:07.322946699 +0000 UTC m=+471.926222905" Jul 13 22:21:07.337008 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:07.336955 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" podStartSLOduration=16.336937681 podStartE2EDuration="16.336937681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:07.336136707 +0000 UTC m=+471.939412934" watchObservedRunningTime="2026-07-13 22:21:07.336937681 +0000 UTC m=+471.940213903" Jul 13 22:21:08.737129 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:08.737097 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4"] Jul 13 22:21:08.982897 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:08.982860 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq"] Jul 13 22:21:08.985697 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:08.985676 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:09.000030 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.000000 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq"] Jul 13 22:21:09.085170 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.085108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tj9jq\" (UID: \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:09.085170 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.085172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrwfw\" (UniqueName: \"kubernetes.io/projected/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-kube-api-access-lrwfw\") pod \"kuadrant-operator-controller-manager-86878c769f-tj9jq\" (UID: \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:09.185806 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.185761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tj9jq\" (UID: \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:09.185806 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.185810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrwfw\" (UniqueName: \"kubernetes.io/projected/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-kube-api-access-lrwfw\") pod \"kuadrant-operator-controller-manager-86878c769f-tj9jq\" (UID: \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:09.186155 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.186135 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tj9jq\" (UID: \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:09.195833 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.195803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrwfw\" (UniqueName: \"kubernetes.io/projected/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-kube-api-access-lrwfw\") pod \"kuadrant-operator-controller-manager-86878c769f-tj9jq\" (UID: \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:09.296329 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.296296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:09.304867 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.304822 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" podUID="dbf4a9c3-f4f1-4fee-8d07-d13d05b63900" containerName="manager" containerID="cri-o://92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f" gracePeriod=10 Jul 13 22:21:09.439483 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.439461 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq"] Jul 13 22:21:09.441593 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:21:09.441566 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd57e4c_761f_4381_9ef0_f8ce6b3377cf.slice/crio-3875450f60a8ef80fafe95671cd75060f8747fd9049ca5628c20033dbc2667fd WatchSource:0}: Error finding container 3875450f60a8ef80fafe95671cd75060f8747fd9049ca5628c20033dbc2667fd: Status 404 returned error can't find the container with id 3875450f60a8ef80fafe95671cd75060f8747fd9049ca5628c20033dbc2667fd Jul 13 22:21:09.552328 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.552262 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:21:09.690356 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.690318 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-extensions-socket-volume\") pod \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\" (UID: \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\") " Jul 13 22:21:09.690592 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.690492 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9dfv\" (UniqueName: \"kubernetes.io/projected/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-kube-api-access-j9dfv\") pod \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\" (UID: \"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900\") " Jul 13 22:21:09.690764 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.690735 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dbf4a9c3-f4f1-4fee-8d07-d13d05b63900" (UID: "dbf4a9c3-f4f1-4fee-8d07-d13d05b63900"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:21:09.692488 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.692466 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-kube-api-access-j9dfv" (OuterVolumeSpecName: "kube-api-access-j9dfv") pod "dbf4a9c3-f4f1-4fee-8d07-d13d05b63900" (UID: "dbf4a9c3-f4f1-4fee-8d07-d13d05b63900"). InnerVolumeSpecName "kube-api-access-j9dfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:21:09.791530 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.791489 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9dfv\" (UniqueName: \"kubernetes.io/projected/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-kube-api-access-j9dfv\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:21:09.791530 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:09.791523 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900-extensions-socket-volume\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:21:10.312089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.312057 2581 generic.go:356] "Generic (PLEG): container finished" podID="dbf4a9c3-f4f1-4fee-8d07-d13d05b63900" containerID="92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f" exitCode=0 Jul 13 22:21:10.312351 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.312128 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" Jul 13 22:21:10.312351 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.312142 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" event={"ID":"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900","Type":"ContainerDied","Data":"92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f"} Jul 13 22:21:10.312351 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.312202 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4" event={"ID":"dbf4a9c3-f4f1-4fee-8d07-d13d05b63900","Type":"ContainerDied","Data":"2be105267dcaa599dedf044f283d7c6b97945524efd25eb23c3a8994be043e5b"} Jul 13 22:21:10.312351 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.312226 2581 scope.go:117] "RemoveContainer" containerID="92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f" Jul 13 22:21:10.313882 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.313855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" event={"ID":"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf","Type":"ContainerStarted","Data":"5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969"} Jul 13 22:21:10.313985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.313914 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" event={"ID":"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf","Type":"ContainerStarted","Data":"3875450f60a8ef80fafe95671cd75060f8747fd9049ca5628c20033dbc2667fd"} Jul 13 22:21:10.313985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.313946 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:10.322083 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.322052 2581 scope.go:117] "RemoveContainer" containerID="92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f" Jul 13 22:21:10.322472 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:21:10.322438 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f\": container with ID starting with 92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f not found: ID does not exist" containerID="92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f" Jul 13 22:21:10.322592 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.322482 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f"} err="failed to get container status \"92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f\": rpc error: code = NotFound desc = could not find container \"92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f\": container with ID starting with 92d2eea52dc91bd2a9480ce43d1b5a326560f466c8e604ad2b86a897fd84100f not found: ID does not exist" Jul 13 22:21:10.336661 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.336629 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4"] Jul 13 22:21:10.346237 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.346211 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xh5z4"] Jul 13 22:21:10.368074 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:10.368017 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" podStartSLOduration=2.36800029 podStartE2EDuration="2.36800029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:21:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:10.364570798 +0000 UTC m=+474.967847026" watchObservedRunningTime="2026-07-13 22:21:10.36800029 +0000 UTC m=+474.971276517" Jul 13 22:21:11.907800 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:11.907764 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbf4a9c3-f4f1-4fee-8d07-d13d05b63900" path="/var/lib/kubelet/pods/dbf4a9c3-f4f1-4fee-8d07-d13d05b63900/volumes" Jul 13 22:21:16.791792 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.791756 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58c7f8d57b-lbhdc"] Jul 13 22:21:16.792213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.792139 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbf4a9c3-f4f1-4fee-8d07-d13d05b63900" containerName="manager" Jul 13 22:21:16.792213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.792150 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbf4a9c3-f4f1-4fee-8d07-d13d05b63900" containerName="manager" Jul 13 22:21:16.792291 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.792231 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbf4a9c3-f4f1-4fee-8d07-d13d05b63900" containerName="manager" Jul 13 22:21:16.795372 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.795340 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.807477 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.807444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c7f8d57b-lbhdc"] Jul 13 22:21:16.844589 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.844539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-oauth-serving-cert\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.844589 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.844590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-console-serving-cert\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.844841 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.844618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-trusted-ca-bundle\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.844841 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.844648 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-console-oauth-config\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.844841 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.844686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-service-ca\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.844841 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.844776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv9fm\" (UniqueName: \"kubernetes.io/projected/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-kube-api-access-fv9fm\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.844841 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.844819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-console-config\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.898634 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.898588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:16.945248 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.945197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-oauth-serving-cert\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.945503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.945255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-console-serving-cert\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.945503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.945280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-trusted-ca-bundle\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.945503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.945304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-console-oauth-config\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.945503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.945329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-service-ca\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.945503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.945391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv9fm\" (UniqueName: \"kubernetes.io/projected/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-kube-api-access-fv9fm\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.945503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.945453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-console-config\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.946141 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.946103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-oauth-serving-cert\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.946238 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.946140 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-service-ca\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.946238 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.946188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-console-config\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.946539 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.946268 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-trusted-ca-bundle\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.947831 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.947804 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-console-serving-cert\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.947943 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.947926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-console-oauth-config\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.952985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.952963 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv9fm\" (UniqueName: \"kubernetes.io/projected/95a08a57-a1a7-44f1-9fe6-2e76dab39e95-kube-api-access-fv9fm\") pod \"console-58c7f8d57b-lbhdc\" (UID: \"95a08a57-a1a7-44f1-9fe6-2e76dab39e95\") " pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:16.998476 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:16.998389 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:17.065808 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:17.065714 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:17.106825 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:17.106791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:17.250363 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:17.250338 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c7f8d57b-lbhdc"] Jul 13 22:21:17.253116 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:21:17.253079 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a08a57_a1a7_44f1_9fe6_2e76dab39e95.slice/crio-08d9ed1f00148ed53b4c4621b8993349e775936de76c7d5473a3625ac69facb2 WatchSource:0}: Error finding container 08d9ed1f00148ed53b4c4621b8993349e775936de76c7d5473a3625ac69facb2: Status 404 returned error can't find the container with id 08d9ed1f00148ed53b4c4621b8993349e775936de76c7d5473a3625ac69facb2 Jul 13 22:21:17.355275 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:17.355242 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c7f8d57b-lbhdc" event={"ID":"95a08a57-a1a7-44f1-9fe6-2e76dab39e95","Type":"ContainerStarted","Data":"885818956c97a9e2d04f55801d3f66c786afed8bfc9d66e97972ad42837d9e13"} Jul 13 22:21:17.355466 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:17.355289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c7f8d57b-lbhdc" event={"ID":"95a08a57-a1a7-44f1-9fe6-2e76dab39e95","Type":"ContainerStarted","Data":"08d9ed1f00148ed53b4c4621b8993349e775936de76c7d5473a3625ac69facb2"} Jul 13 22:21:17.373067 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:17.373012 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58c7f8d57b-lbhdc" podStartSLOduration=1.372993844 podStartE2EDuration="1.372993844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:21:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:17.37197478 +0000 UTC m=+481.975251008" watchObservedRunningTime="2026-07-13 22:21:17.372993844 +0000 UTC m=+481.976270070" Jul 13 22:21:17.730797 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:17.730714 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:17.832541 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:17.832497 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:17.888229 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:17.888196 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:18.298534 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:18.298502 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n6chv" Jul 13 22:21:21.323303 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:21.323264 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:21:25.135633 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:25.135564 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:25.678557 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:25.678520 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:27.108048 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:27.108015 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:27.108468 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:27.108070 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:27.112852 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:27.112824 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:27.417026 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:27.416952 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58c7f8d57b-lbhdc" Jul 13 22:21:27.463844 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:27.463817 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8fb66746-42r9d"] Jul 13 22:21:27.584213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:27.584180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:27.685415 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:27.685311 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:27.739313 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:27.739291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:38.486232 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:38.486201 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:38.594098 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:38.594062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:38.648826 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:38.648789 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:38.954331 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:38.954298 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:21:38.956865 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:38.956844 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:21:38.958727 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:38.958707 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 22:21:38.965077 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:38.965050 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:21:38.998998 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:38.998969 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:21:39.032785 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.032760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bac5bc12-2c80-4d97-a462-0714f5f758e2-config-file\") pod \"limitador-limitador-54d6d988d5-rntt8\" (UID: \"bac5bc12-2c80-4d97-a462-0714f5f758e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:21:39.032905 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.032876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t72ng\" (UniqueName: \"kubernetes.io/projected/bac5bc12-2c80-4d97-a462-0714f5f758e2-kube-api-access-t72ng\") pod \"limitador-limitador-54d6d988d5-rntt8\" (UID: \"bac5bc12-2c80-4d97-a462-0714f5f758e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:21:39.133826 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.133798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t72ng\" (UniqueName: \"kubernetes.io/projected/bac5bc12-2c80-4d97-a462-0714f5f758e2-kube-api-access-t72ng\") pod \"limitador-limitador-54d6d988d5-rntt8\" (UID: \"bac5bc12-2c80-4d97-a462-0714f5f758e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:21:39.133985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.133842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bac5bc12-2c80-4d97-a462-0714f5f758e2-config-file\") pod \"limitador-limitador-54d6d988d5-rntt8\" (UID: \"bac5bc12-2c80-4d97-a462-0714f5f758e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:21:39.134391 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.134375 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bac5bc12-2c80-4d97-a462-0714f5f758e2-config-file\") pod \"limitador-limitador-54d6d988d5-rntt8\" (UID: \"bac5bc12-2c80-4d97-a462-0714f5f758e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:21:39.141824 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.141790 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t72ng\" (UniqueName: \"kubernetes.io/projected/bac5bc12-2c80-4d97-a462-0714f5f758e2-kube-api-access-t72ng\") pod \"limitador-limitador-54d6d988d5-rntt8\" (UID: \"bac5bc12-2c80-4d97-a462-0714f5f758e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:21:39.268899 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.268868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:21:39.343811 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.343767 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:39.395851 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.395802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:21:39.407561 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.407537 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:21:39.409206 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:21:39.409182 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac5bc12_2c80_4d97_a462_0714f5f758e2.slice/crio-bd20a0a59786a6b5c3db9e536951e66d6c32b7a578ce64673dc5be27ce253852 WatchSource:0}: Error finding container bd20a0a59786a6b5c3db9e536951e66d6c32b7a578ce64673dc5be27ce253852: Status 404 returned error can't find the container with id bd20a0a59786a6b5c3db9e536951e66d6c32b7a578ce64673dc5be27ce253852 Jul 13 22:21:39.423674 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.423652 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcfd5"] Jul 13 22:21:39.426537 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.426521 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hcfd5" Jul 13 22:21:39.428316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.428300 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f2rp6\"" Jul 13 22:21:39.432592 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.432568 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcfd5"] Jul 13 22:21:39.483541 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.483506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" event={"ID":"bac5bc12-2c80-4d97-a462-0714f5f758e2","Type":"ContainerStarted","Data":"bd20a0a59786a6b5c3db9e536951e66d6c32b7a578ce64673dc5be27ce253852"} Jul 13 22:21:39.537906 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.537845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5lwl\" (UniqueName: \"kubernetes.io/projected/87e84c75-545a-46e0-b135-c8b7d3ecc6cd-kube-api-access-f5lwl\") pod \"authorino-75d556bd77-hcfd5\" (UID: \"87e84c75-545a-46e0-b135-c8b7d3ecc6cd\") " pod="kuadrant-system/authorino-75d556bd77-hcfd5" Jul 13 22:21:39.638534 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.638505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5lwl\" (UniqueName: \"kubernetes.io/projected/87e84c75-545a-46e0-b135-c8b7d3ecc6cd-kube-api-access-f5lwl\") pod \"authorino-75d556bd77-hcfd5\" (UID: \"87e84c75-545a-46e0-b135-c8b7d3ecc6cd\") " pod="kuadrant-system/authorino-75d556bd77-hcfd5" Jul 13 22:21:39.646521 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.646459 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5lwl\" (UniqueName: \"kubernetes.io/projected/87e84c75-545a-46e0-b135-c8b7d3ecc6cd-kube-api-access-f5lwl\") pod \"authorino-75d556bd77-hcfd5\" (UID: \"87e84c75-545a-46e0-b135-c8b7d3ecc6cd\") " pod="kuadrant-system/authorino-75d556bd77-hcfd5" Jul 13 22:21:39.737699 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.737666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hcfd5" Jul 13 22:21:39.867282 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:39.867251 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcfd5"] Jul 13 22:21:39.868323 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:21:39.868296 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87e84c75_545a_46e0_b135_c8b7d3ecc6cd.slice/crio-758910d4127c469dc58302b28835e70a260116d705383d003bed213560a38f71 WatchSource:0}: Error finding container 758910d4127c469dc58302b28835e70a260116d705383d003bed213560a38f71: Status 404 returned error can't find the container with id 758910d4127c469dc58302b28835e70a260116d705383d003bed213560a38f71 Jul 13 22:21:40.493652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:40.493610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hcfd5" event={"ID":"87e84c75-545a-46e0-b135-c8b7d3ecc6cd","Type":"ContainerStarted","Data":"758910d4127c469dc58302b28835e70a260116d705383d003bed213560a38f71"} Jul 13 22:21:44.518883 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:44.518848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" event={"ID":"bac5bc12-2c80-4d97-a462-0714f5f758e2","Type":"ContainerStarted","Data":"b7bc192fcd622affdc341cfbee3a2b5de3ffa52108c845ae42bc0faa7d904b22"} Jul 13 22:21:44.519303 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:44.518909 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:21:44.520402 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:44.520372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hcfd5" event={"ID":"87e84c75-545a-46e0-b135-c8b7d3ecc6cd","Type":"ContainerStarted","Data":"65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033"} Jul 13 22:21:44.534777 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:44.534730 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" podStartSLOduration=2.172835256 podStartE2EDuration="6.534713742s" totalImagesPullingTime="4.361878486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:44.532619146 +0000 UTC m=+509.135895374" watchObservedRunningTime="2026-07-13 22:21:44.534713742 +0000 UTC m=+509.137989970" Jul 13 22:21:44.546204 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:44.546165 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hcfd5" podStartSLOduration=1.635826406 podStartE2EDuration="5.546151817s" totalImagesPullingTime="3.910325411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:21:44.544057751 +0000 UTC m=+509.147333979" watchObservedRunningTime="2026-07-13 22:21:44.546151817 +0000 UTC m=+509.149428090" Jul 13 22:21:52.492070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.492016 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c8fb66746-42r9d" podUID="2cb149fe-44da-4e4e-88a2-d3e2bde0be61" containerName="console" containerID="cri-o://4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe" gracePeriod=15 Jul 13 22:21:52.749001 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.748947 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:21:52.853104 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853072 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-oauth-serving-cert\") pod \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " Jul 13 22:21:52.853104 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853104 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-service-ca\") pod \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " Jul 13 22:21:52.853328 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853135 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-config\") pod \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " Jul 13 22:21:52.853328 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853162 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-oauth-config\") pod \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " Jul 13 22:21:52.853328 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853182 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-trusted-ca-bundle\") pod \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " Jul 13 22:21:52.853328 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853251 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgnpj\" (UniqueName: \"kubernetes.io/projected/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-kube-api-access-dgnpj\") pod \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " Jul 13 22:21:52.853328 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853298 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-serving-cert\") pod \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\" (UID: \"2cb149fe-44da-4e4e-88a2-d3e2bde0be61\") " Jul 13 22:21:52.853629 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853602 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-service-ca" (OuterVolumeSpecName: "service-ca") pod "2cb149fe-44da-4e4e-88a2-d3e2bde0be61" (UID: "2cb149fe-44da-4e4e-88a2-d3e2bde0be61"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:21:52.853629 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853611 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2cb149fe-44da-4e4e-88a2-d3e2bde0be61" (UID: "2cb149fe-44da-4e4e-88a2-d3e2bde0be61"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:21:52.853629 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853620 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-config" (OuterVolumeSpecName: "console-config") pod "2cb149fe-44da-4e4e-88a2-d3e2bde0be61" (UID: "2cb149fe-44da-4e4e-88a2-d3e2bde0be61"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:21:52.853785 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.853753 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2cb149fe-44da-4e4e-88a2-d3e2bde0be61" (UID: "2cb149fe-44da-4e4e-88a2-d3e2bde0be61"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 22:21:52.855382 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.855351 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2cb149fe-44da-4e4e-88a2-d3e2bde0be61" (UID: "2cb149fe-44da-4e4e-88a2-d3e2bde0be61"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:21:52.855529 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.855503 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2cb149fe-44da-4e4e-88a2-d3e2bde0be61" (UID: "2cb149fe-44da-4e4e-88a2-d3e2bde0be61"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:21:52.855576 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.855525 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-kube-api-access-dgnpj" (OuterVolumeSpecName: "kube-api-access-dgnpj") pod "2cb149fe-44da-4e4e-88a2-d3e2bde0be61" (UID: "2cb149fe-44da-4e4e-88a2-d3e2bde0be61"). InnerVolumeSpecName "kube-api-access-dgnpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:21:52.954485 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.954461 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-config\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:21:52.954485 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.954481 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-oauth-config\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:21:52.954485 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.954491 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-trusted-ca-bundle\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:21:52.954681 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.954501 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgnpj\" (UniqueName: \"kubernetes.io/projected/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-kube-api-access-dgnpj\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:21:52.954681 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.954510 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-console-serving-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:21:52.954681 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.954520 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-oauth-serving-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:21:52.954681 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:52.954528 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb149fe-44da-4e4e-88a2-d3e2bde0be61-service-ca\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:21:53.572099 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.572064 2581 generic.go:356] "Generic (PLEG): container finished" podID="2cb149fe-44da-4e4e-88a2-d3e2bde0be61" containerID="4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe" exitCode=0 Jul 13 22:21:53.572538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.572129 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8fb66746-42r9d" Jul 13 22:21:53.572538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.572152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8fb66746-42r9d" event={"ID":"2cb149fe-44da-4e4e-88a2-d3e2bde0be61","Type":"ContainerDied","Data":"4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe"} Jul 13 22:21:53.572538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.572233 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8fb66746-42r9d" event={"ID":"2cb149fe-44da-4e4e-88a2-d3e2bde0be61","Type":"ContainerDied","Data":"0af5194bfe0368ecb4818183a8af2bbe150d7e2b9ced7af19e2c29a5592fba00"} Jul 13 22:21:53.572538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.572260 2581 scope.go:117] "RemoveContainer" containerID="4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe" Jul 13 22:21:53.581890 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.581874 2581 scope.go:117] "RemoveContainer" containerID="4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe" Jul 13 22:21:53.582133 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:21:53.582115 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe\": container with ID starting with 4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe not found: ID does not exist" containerID="4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe" Jul 13 22:21:53.582206 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.582140 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe"} err="failed to get container status \"4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe\": rpc error: code = NotFound desc = could not find container \"4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe\": container with ID starting with 4fe03ce4f4d8b311303d4d0031b9243c264c0f6cc0333163de062f1e42c25ffe not found: ID does not exist" Jul 13 22:21:53.592008 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.591987 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8fb66746-42r9d"] Jul 13 22:21:53.597822 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.597802 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c8fb66746-42r9d"] Jul 13 22:21:53.907728 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:53.907659 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb149fe-44da-4e4e-88a2-d3e2bde0be61" path="/var/lib/kubelet/pods/2cb149fe-44da-4e4e-88a2-d3e2bde0be61/volumes" Jul 13 22:21:55.526552 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:21:55.526518 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rntt8" Jul 13 22:22:01.354244 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:01.354206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:01.449402 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:01.449367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:01.817297 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:01.817261 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:13.383932 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.383890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:13.484650 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.484607 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:13.604960 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.604927 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qbnn7"] Jul 13 22:22:13.605323 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.605310 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb149fe-44da-4e4e-88a2-d3e2bde0be61" containerName="console" Jul 13 22:22:13.605323 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.605324 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb149fe-44da-4e4e-88a2-d3e2bde0be61" containerName="console" Jul 13 22:22:13.605477 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.605409 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cb149fe-44da-4e4e-88a2-d3e2bde0be61" containerName="console" Jul 13 22:22:13.668255 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.668164 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qbnn7"] Jul 13 22:22:13.668255 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.668206 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" Jul 13 22:22:13.726346 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.726304 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5whxh\" (UniqueName: \"kubernetes.io/projected/522be2a8-80c7-4614-9157-7ccd8eea333b-kube-api-access-5whxh\") pod \"authorino-5d4b67c446-qbnn7\" (UID: \"522be2a8-80c7-4614-9157-7ccd8eea333b\") " pod="kuadrant-system/authorino-5d4b67c446-qbnn7" Jul 13 22:22:13.827704 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.827665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5whxh\" (UniqueName: \"kubernetes.io/projected/522be2a8-80c7-4614-9157-7ccd8eea333b-kube-api-access-5whxh\") pod \"authorino-5d4b67c446-qbnn7\" (UID: \"522be2a8-80c7-4614-9157-7ccd8eea333b\") " pod="kuadrant-system/authorino-5d4b67c446-qbnn7" Jul 13 22:22:13.835302 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.835276 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5whxh\" (UniqueName: \"kubernetes.io/projected/522be2a8-80c7-4614-9157-7ccd8eea333b-kube-api-access-5whxh\") pod \"authorino-5d4b67c446-qbnn7\" (UID: \"522be2a8-80c7-4614-9157-7ccd8eea333b\") " pod="kuadrant-system/authorino-5d4b67c446-qbnn7" Jul 13 22:22:13.839034 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.839009 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qbnn7"] Jul 13 22:22:13.839270 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.839258 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" Jul 13 22:22:13.864825 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.864793 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d6869bb6d-vzzdq"] Jul 13 22:22:13.884333 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.884299 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d6869bb6d-vzzdq"] Jul 13 22:22:13.884519 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.884437 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d6869bb6d-vzzdq" Jul 13 22:22:13.894167 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.894139 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d6869bb6d-vzzdq"] Jul 13 22:22:13.895847 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:22:13.895815 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d8fnr], unattached volumes=[], failed to process volumes=[kube-api-access-d8fnr]: context canceled" pod="kuadrant-system/authorino-5d6869bb6d-vzzdq" podUID="9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc" Jul 13 22:22:13.918633 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.918607 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cd895d7c6-nrhlm"] Jul 13 22:22:13.929031 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.928645 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8fnr\" (UniqueName: \"kubernetes.io/projected/9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc-kube-api-access-d8fnr\") pod \"authorino-5d6869bb6d-vzzdq\" (UID: \"9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc\") " pod="kuadrant-system/authorino-5d6869bb6d-vzzdq" Jul 13 22:22:13.944301 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.944270 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cd895d7c6-nrhlm"] Jul 13 22:22:13.944498 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.944364 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:22:13.946609 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:13.946591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 13 22:22:14.007866 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.007835 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qbnn7"] Jul 13 22:22:14.009546 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:22:14.009517 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod522be2a8_80c7_4614_9157_7ccd8eea333b.slice/crio-1a463253559da5d56113d7dd11f8756a4659d3d6f75915add47aa6243ab3d8eb WatchSource:0}: Error finding container 1a463253559da5d56113d7dd11f8756a4659d3d6f75915add47aa6243ab3d8eb: Status 404 returned error can't find the container with id 1a463253559da5d56113d7dd11f8756a4659d3d6f75915add47aa6243ab3d8eb Jul 13 22:22:14.029465 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.029414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35493a67-ab1a-4c71-9158-3b0dae0be0a9-tls-cert\") pod \"authorino-cd895d7c6-nrhlm\" (UID: \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\") " pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:22:14.029654 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.029512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8fnr\" (UniqueName: \"kubernetes.io/projected/9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc-kube-api-access-d8fnr\") pod \"authorino-5d6869bb6d-vzzdq\" (UID: \"9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc\") " pod="kuadrant-system/authorino-5d6869bb6d-vzzdq" Jul 13 22:22:14.029654 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.029578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c722q\" (UniqueName: \"kubernetes.io/projected/35493a67-ab1a-4c71-9158-3b0dae0be0a9-kube-api-access-c722q\") pod \"authorino-cd895d7c6-nrhlm\" (UID: \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\") " pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:22:14.036873 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.036844 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8fnr\" (UniqueName: \"kubernetes.io/projected/9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc-kube-api-access-d8fnr\") pod \"authorino-5d6869bb6d-vzzdq\" (UID: \"9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc\") " pod="kuadrant-system/authorino-5d6869bb6d-vzzdq" Jul 13 22:22:14.130834 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.130793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35493a67-ab1a-4c71-9158-3b0dae0be0a9-tls-cert\") pod \"authorino-cd895d7c6-nrhlm\" (UID: \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\") " pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:22:14.131012 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.130895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c722q\" (UniqueName: \"kubernetes.io/projected/35493a67-ab1a-4c71-9158-3b0dae0be0a9-kube-api-access-c722q\") pod \"authorino-cd895d7c6-nrhlm\" (UID: \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\") " pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:22:14.133314 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.133288 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35493a67-ab1a-4c71-9158-3b0dae0be0a9-tls-cert\") pod \"authorino-cd895d7c6-nrhlm\" (UID: \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\") " pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:22:14.138571 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.138546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c722q\" (UniqueName: \"kubernetes.io/projected/35493a67-ab1a-4c71-9158-3b0dae0be0a9-kube-api-access-c722q\") pod \"authorino-cd895d7c6-nrhlm\" (UID: \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\") " pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:22:14.254222 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.254192 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:22:14.414824 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.414797 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cd895d7c6-nrhlm"] Jul 13 22:22:14.416220 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:22:14.416192 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35493a67_ab1a_4c71_9158_3b0dae0be0a9.slice/crio-b32d895ec9504f63b9dd968132a3943726496caa91511cfc80b1c232d1418dd6 WatchSource:0}: Error finding container b32d895ec9504f63b9dd968132a3943726496caa91511cfc80b1c232d1418dd6: Status 404 returned error can't find the container with id b32d895ec9504f63b9dd968132a3943726496caa91511cfc80b1c232d1418dd6 Jul 13 22:22:14.700538 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.700490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" event={"ID":"35493a67-ab1a-4c71-9158-3b0dae0be0a9","Type":"ContainerStarted","Data":"b32d895ec9504f63b9dd968132a3943726496caa91511cfc80b1c232d1418dd6"} Jul 13 22:22:14.702307 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.702275 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" event={"ID":"522be2a8-80c7-4614-9157-7ccd8eea333b","Type":"ContainerStarted","Data":"1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe"} Jul 13 22:22:14.702488 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.702327 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" event={"ID":"522be2a8-80c7-4614-9157-7ccd8eea333b","Type":"ContainerStarted","Data":"1a463253559da5d56113d7dd11f8756a4659d3d6f75915add47aa6243ab3d8eb"} Jul 13 22:22:14.702488 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.702293 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d6869bb6d-vzzdq" Jul 13 22:22:14.702488 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.702408 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" podUID="522be2a8-80c7-4614-9157-7ccd8eea333b" containerName="authorino" containerID="cri-o://1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe" gracePeriod=30 Jul 13 22:22:14.708884 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.708857 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d6869bb6d-vzzdq" Jul 13 22:22:14.735189 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.735155 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8fnr\" (UniqueName: \"kubernetes.io/projected/9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc-kube-api-access-d8fnr\") pod \"9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc\" (UID: \"9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc\") " Jul 13 22:22:14.737601 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.737559 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc-kube-api-access-d8fnr" (OuterVolumeSpecName: "kube-api-access-d8fnr") pod "9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc" (UID: "9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc"). InnerVolumeSpecName "kube-api-access-d8fnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:22:14.739308 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.739262 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" podStartSLOduration=1.15915919 podStartE2EDuration="1.73924647s" totalImagesPullingTime="580.08728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:22:14.736826849 +0000 UTC m=+539.340103075" watchObservedRunningTime="2026-07-13 22:22:14.73924647 +0000 UTC m=+539.342522699" Jul 13 22:22:14.836449 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.836405 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8fnr\" (UniqueName: \"kubernetes.io/projected/9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc-kube-api-access-d8fnr\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:22:14.966041 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:14.966014 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" Jul 13 22:22:15.038062 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.038026 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5whxh\" (UniqueName: \"kubernetes.io/projected/522be2a8-80c7-4614-9157-7ccd8eea333b-kube-api-access-5whxh\") pod \"522be2a8-80c7-4614-9157-7ccd8eea333b\" (UID: \"522be2a8-80c7-4614-9157-7ccd8eea333b\") " Jul 13 22:22:15.040071 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.040041 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522be2a8-80c7-4614-9157-7ccd8eea333b-kube-api-access-5whxh" (OuterVolumeSpecName: "kube-api-access-5whxh") pod "522be2a8-80c7-4614-9157-7ccd8eea333b" (UID: "522be2a8-80c7-4614-9157-7ccd8eea333b"). InnerVolumeSpecName "kube-api-access-5whxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:22:15.138820 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.138735 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5whxh\" (UniqueName: \"kubernetes.io/projected/522be2a8-80c7-4614-9157-7ccd8eea333b-kube-api-access-5whxh\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:22:15.709151 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.709116 2581 generic.go:356] "Generic (PLEG): container finished" podID="522be2a8-80c7-4614-9157-7ccd8eea333b" containerID="1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe" exitCode=0 Jul 13 22:22:15.709608 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.709179 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" Jul 13 22:22:15.709608 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.709166 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" event={"ID":"522be2a8-80c7-4614-9157-7ccd8eea333b","Type":"ContainerDied","Data":"1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe"} Jul 13 22:22:15.709608 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.709297 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qbnn7" event={"ID":"522be2a8-80c7-4614-9157-7ccd8eea333b","Type":"ContainerDied","Data":"1a463253559da5d56113d7dd11f8756a4659d3d6f75915add47aa6243ab3d8eb"} Jul 13 22:22:15.709608 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.709320 2581 scope.go:117] "RemoveContainer" containerID="1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe" Jul 13 22:22:15.711259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.711234 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d6869bb6d-vzzdq" Jul 13 22:22:15.711259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.711241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" event={"ID":"35493a67-ab1a-4c71-9158-3b0dae0be0a9","Type":"ContainerStarted","Data":"21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066"} Jul 13 22:22:15.720040 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.720016 2581 scope.go:117] "RemoveContainer" containerID="1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe" Jul 13 22:22:15.720360 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:22:15.720342 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe\": container with ID starting with 1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe not found: ID does not exist" containerID="1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe" Jul 13 22:22:15.720408 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.720370 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe"} err="failed to get container status \"1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe\": rpc error: code = NotFound desc = could not find container \"1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe\": container with ID starting with 1ad866bb5e4b50646ef3d5305a1fa1f7d41b9231ce23215036b5a7f9ddc724fe not found: ID does not exist" Jul 13 22:22:15.729772 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.729718 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" podStartSLOduration=2.3891503419999998 podStartE2EDuration="2.729701716s" totalImagesPullingTime="340.551374ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:22:15.728278291 +0000 UTC m=+540.331554519" watchObservedRunningTime="2026-07-13 22:22:15.729701716 +0000 UTC m=+540.332977943" Jul 13 22:22:15.757205 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.757175 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d6869bb6d-vzzdq"] Jul 13 22:22:15.764139 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.764105 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcfd5"] Jul 13 22:22:15.764359 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.764324 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hcfd5" podUID="87e84c75-545a-46e0-b135-c8b7d3ecc6cd" containerName="authorino" containerID="cri-o://65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033" gracePeriod=30 Jul 13 22:22:15.768041 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.768016 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d6869bb6d-vzzdq"] Jul 13 22:22:15.785010 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.784980 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qbnn7"] Jul 13 22:22:15.791525 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.791500 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qbnn7"] Jul 13 22:22:15.908655 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.908625 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="522be2a8-80c7-4614-9157-7ccd8eea333b" path="/var/lib/kubelet/pods/522be2a8-80c7-4614-9157-7ccd8eea333b/volumes" Jul 13 22:22:15.908954 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:15.908941 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc" path="/var/lib/kubelet/pods/9b4fa559-f4f5-479c-ac8b-adeb0b68d7dc/volumes" Jul 13 22:22:16.026011 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.025983 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hcfd5" Jul 13 22:22:16.046004 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.045975 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5lwl\" (UniqueName: \"kubernetes.io/projected/87e84c75-545a-46e0-b135-c8b7d3ecc6cd-kube-api-access-f5lwl\") pod \"87e84c75-545a-46e0-b135-c8b7d3ecc6cd\" (UID: \"87e84c75-545a-46e0-b135-c8b7d3ecc6cd\") " Jul 13 22:22:16.048310 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.048282 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87e84c75-545a-46e0-b135-c8b7d3ecc6cd-kube-api-access-f5lwl" (OuterVolumeSpecName: "kube-api-access-f5lwl") pod "87e84c75-545a-46e0-b135-c8b7d3ecc6cd" (UID: "87e84c75-545a-46e0-b135-c8b7d3ecc6cd"). InnerVolumeSpecName "kube-api-access-f5lwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:22:16.147192 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.147156 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5lwl\" (UniqueName: \"kubernetes.io/projected/87e84c75-545a-46e0-b135-c8b7d3ecc6cd-kube-api-access-f5lwl\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:22:16.718533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.718500 2581 generic.go:356] "Generic (PLEG): container finished" podID="87e84c75-545a-46e0-b135-c8b7d3ecc6cd" containerID="65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033" exitCode=0 Jul 13 22:22:16.718964 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.718543 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hcfd5" Jul 13 22:22:16.718964 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.718584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hcfd5" event={"ID":"87e84c75-545a-46e0-b135-c8b7d3ecc6cd","Type":"ContainerDied","Data":"65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033"} Jul 13 22:22:16.718964 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.718623 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hcfd5" event={"ID":"87e84c75-545a-46e0-b135-c8b7d3ecc6cd","Type":"ContainerDied","Data":"758910d4127c469dc58302b28835e70a260116d705383d003bed213560a38f71"} Jul 13 22:22:16.718964 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.718645 2581 scope.go:117] "RemoveContainer" containerID="65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033" Jul 13 22:22:16.728327 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.728308 2581 scope.go:117] "RemoveContainer" containerID="65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033" Jul 13 22:22:16.728656 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:22:16.728636 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033\": container with ID starting with 65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033 not found: ID does not exist" containerID="65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033" Jul 13 22:22:16.728737 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.728664 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033"} err="failed to get container status \"65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033\": rpc error: code = NotFound desc = could not find container \"65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033\": container with ID starting with 65eb08ecac0a2105fbb0cc251cf8ee1464214844514e7f7566dedb4642cb5033 not found: ID does not exist" Jul 13 22:22:16.738433 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.738388 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcfd5"] Jul 13 22:22:16.744145 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:16.744114 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcfd5"] Jul 13 22:22:17.911332 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:17.911300 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87e84c75-545a-46e0-b135-c8b7d3ecc6cd" path="/var/lib/kubelet/pods/87e84c75-545a-46e0-b135-c8b7d3ecc6cd/volumes" Jul 13 22:22:20.063454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:20.063397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:20.161790 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:20.161753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:20.242688 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:20.242649 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:20.299354 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:20.299322 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:22.769482 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:22.769445 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:22.858106 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:22.858072 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:50.726269 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:50.726231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:54.273601 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:54.273566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:54.732317 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:54.732286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:54.916762 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:54.916728 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:55.263482 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:55.263448 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:55.359727 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:55.359693 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:22:55.462376 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:55.462344 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:22:58.342211 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:22:58.342169 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:05.790165 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:05.790118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:05.894970 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:05.894937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:13.913012 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:13.912974 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:14.579765 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:14.579719 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:23:15.818945 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:15.818915 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:23:15.819342 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:15.819232 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:23:15.821348 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:15.821323 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:23:15.821858 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:15.821840 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:23:19.312033 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:19.311998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:19.986035 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:19.985997 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:23:23.085364 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:23.085324 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:24.184677 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:24.184651 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:23:26.878443 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.876303 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598"] Jul 13 22:23:26.878443 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.877241 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522be2a8-80c7-4614-9157-7ccd8eea333b" containerName="authorino" Jul 13 22:23:26.878443 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.877263 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="522be2a8-80c7-4614-9157-7ccd8eea333b" containerName="authorino" Jul 13 22:23:26.878443 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.877276 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87e84c75-545a-46e0-b135-c8b7d3ecc6cd" containerName="authorino" Jul 13 22:23:26.878443 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.877284 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="87e84c75-545a-46e0-b135-c8b7d3ecc6cd" containerName="authorino" Jul 13 22:23:26.878443 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.877520 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="87e84c75-545a-46e0-b135-c8b7d3ecc6cd" containerName="authorino" Jul 13 22:23:26.878443 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.877545 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="522be2a8-80c7-4614-9157-7ccd8eea333b" containerName="authorino" Jul 13 22:23:26.885061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.885029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:26.887370 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.887346 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 22:23:26.887638 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.887617 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 13 22:23:26.887819 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.887595 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 22:23:26.888093 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.888074 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2zd2s\"" Jul 13 22:23:26.891160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.891134 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598"] Jul 13 22:23:26.917913 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.917878 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:26.958244 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.958220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:26.958394 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.958259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:26.958394 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.958278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8ch5\" (UniqueName: \"kubernetes.io/projected/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-kube-api-access-f8ch5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:26.958543 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.958416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:26.958543 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.958522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:26.958686 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:26.958556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.059212 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.059178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.059354 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.059244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.059354 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.059275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.059354 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.059310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.059354 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.059346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.059603 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.059370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8ch5\" (UniqueName: \"kubernetes.io/projected/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-kube-api-access-f8ch5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.059789 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.059756 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.059907 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.059790 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.059907 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.059831 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.061579 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.061558 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.061896 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.061879 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.066914 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.066889 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8ch5\" (UniqueName: \"kubernetes.io/projected/6758b3e5-e671-42e9-84a4-178a3a6f8a4b-kube-api-access-f8ch5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598\" (UID: \"6758b3e5-e671-42e9-84a4-178a3a6f8a4b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.197764 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.197682 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:27.333123 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:27.333093 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598"] Jul 13 22:23:27.334465 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:23:27.334439 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6758b3e5_e671_42e9_84a4_178a3a6f8a4b.slice/crio-7a73a0412639795553011ea300735bc7e3d92c57a9f683dd74ff309ccc519cbd WatchSource:0}: Error finding container 7a73a0412639795553011ea300735bc7e3d92c57a9f683dd74ff309ccc519cbd: Status 404 returned error can't find the container with id 7a73a0412639795553011ea300735bc7e3d92c57a9f683dd74ff309ccc519cbd Jul 13 22:23:28.115570 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:28.115536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" event={"ID":"6758b3e5-e671-42e9-84a4-178a3a6f8a4b","Type":"ContainerStarted","Data":"7a73a0412639795553011ea300735bc7e3d92c57a9f683dd74ff309ccc519cbd"} Jul 13 22:23:29.123460 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:29.123402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" event={"ID":"6758b3e5-e671-42e9-84a4-178a3a6f8a4b","Type":"ContainerStarted","Data":"34319f3c09256f0cbccb45ae78cb1e06a8ac84313d3e7445a3553238e791c7b4"} Jul 13 22:23:29.141614 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:29.141557 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" podStartSLOduration=2.102310113 podStartE2EDuration="3.141537073s" totalImagesPullingTime="1.03922696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:23:29.140522292 +0000 UTC m=+613.743798519" watchObservedRunningTime="2026-07-13 22:23:29.141537073 +0000 UTC m=+613.744813301" Jul 13 22:23:32.474768 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:32.474733 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:23:34.913405 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:34.913365 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:35.221869 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:35.221782 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:36.613992 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:36.613951 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:23:37.198180 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:37.198090 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:37.198180 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:37.198176 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:37.212106 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:37.212062 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:38.183090 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:38.183061 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598" Jul 13 22:23:45.770406 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.770370 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm"] Jul 13 22:23:45.773994 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.773970 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:45.776066 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.776038 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 13 22:23:45.784823 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.784800 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm"] Jul 13 22:23:45.811899 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.811863 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:45.927526 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.927491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:45.927712 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.927532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:45.927712 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.927573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8snvw\" (UniqueName: \"kubernetes.io/projected/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-kube-api-access-8snvw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:45.927712 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.927605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:45.927712 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.927652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:45.927712 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:45.927701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.029183 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.029107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8snvw\" (UniqueName: \"kubernetes.io/projected/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-kube-api-access-8snvw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.029183 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.029147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.029183 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.029176 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.029501 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.029212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.029501 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.029277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.029501 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.029404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.029674 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.029583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.029729 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.029719 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.029780 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.029754 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.031484 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.031459 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.032011 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.031989 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.037253 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.037233 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8snvw\" (UniqueName: \"kubernetes.io/projected/5602b3b5-6c3f-49d8-930c-4bc3d67f147a-kube-api-access-8snvw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm\" (UID: \"5602b3b5-6c3f-49d8-930c-4bc3d67f147a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.084053 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.084024 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:46.226370 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.226345 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm"] Jul 13 22:23:46.228647 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:23:46.228617 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5602b3b5_6c3f_49d8_930c_4bc3d67f147a.slice/crio-da542ce13898d35b7957c2cdf96a19251dece4a0d6f6914e778458b6bd308cc6 WatchSource:0}: Error finding container da542ce13898d35b7957c2cdf96a19251dece4a0d6f6914e778458b6bd308cc6: Status 404 returned error can't find the container with id da542ce13898d35b7957c2cdf96a19251dece4a0d6f6914e778458b6bd308cc6 Jul 13 22:23:46.230024 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:46.230006 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 22:23:47.208488 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:47.208449 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:23:47.220955 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:47.220931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" event={"ID":"5602b3b5-6c3f-49d8-930c-4bc3d67f147a","Type":"ContainerStarted","Data":"3bc48e3eb7c1f569b6c3f6b34df10832daebea8ffc25a3c8186f8696d42d5e3c"} Jul 13 22:23:47.221075 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:47.220968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" event={"ID":"5602b3b5-6c3f-49d8-930c-4bc3d67f147a","Type":"ContainerStarted","Data":"da542ce13898d35b7957c2cdf96a19251dece4a0d6f6914e778458b6bd308cc6"} Jul 13 22:23:47.268934 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:47.268888 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" podStartSLOduration=2.088164431 podStartE2EDuration="2.268873859s" totalImagesPullingTime="180.709428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:23:47.267035069 +0000 UTC m=+631.870311297" watchObservedRunningTime="2026-07-13 22:23:47.268873859 +0000 UTC m=+631.872150086" Jul 13 22:23:48.884086 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:48.884048 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:23:56.084536 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:56.084507 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:56.084967 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:56.084756 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:56.097139 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:56.097112 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:23:56.282103 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:23:56.282078 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm" Jul 13 22:24:39.628990 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:39.628939 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:24:39.725802 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:39.725768 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:24:40.757284 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:40.757246 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:24:40.865198 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:40.865161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:24:40.912088 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:40.912056 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd895d7c6-nrhlm"] Jul 13 22:24:40.912258 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:40.912238 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" podUID="35493a67-ab1a-4c71-9158-3b0dae0be0a9" containerName="authorino" containerID="cri-o://21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066" gracePeriod=30 Jul 13 22:24:41.173910 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.173889 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:24:41.318819 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.318735 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c722q\" (UniqueName: \"kubernetes.io/projected/35493a67-ab1a-4c71-9158-3b0dae0be0a9-kube-api-access-c722q\") pod \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\" (UID: \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\") " Jul 13 22:24:41.318819 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.318777 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35493a67-ab1a-4c71-9158-3b0dae0be0a9-tls-cert\") pod \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\" (UID: \"35493a67-ab1a-4c71-9158-3b0dae0be0a9\") " Jul 13 22:24:41.320969 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.320940 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35493a67-ab1a-4c71-9158-3b0dae0be0a9-kube-api-access-c722q" (OuterVolumeSpecName: "kube-api-access-c722q") pod "35493a67-ab1a-4c71-9158-3b0dae0be0a9" (UID: "35493a67-ab1a-4c71-9158-3b0dae0be0a9"). InnerVolumeSpecName "kube-api-access-c722q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:24:41.329638 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.329611 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35493a67-ab1a-4c71-9158-3b0dae0be0a9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "35493a67-ab1a-4c71-9158-3b0dae0be0a9" (UID: "35493a67-ab1a-4c71-9158-3b0dae0be0a9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:24:41.420264 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.420235 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c722q\" (UniqueName: \"kubernetes.io/projected/35493a67-ab1a-4c71-9158-3b0dae0be0a9-kube-api-access-c722q\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:24:41.420264 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.420260 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35493a67-ab1a-4c71-9158-3b0dae0be0a9-tls-cert\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:24:41.542677 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.542650 2581 generic.go:356] "Generic (PLEG): container finished" podID="35493a67-ab1a-4c71-9158-3b0dae0be0a9" containerID="21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066" exitCode=0 Jul 13 22:24:41.542842 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.542694 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" Jul 13 22:24:41.542842 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.542725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" event={"ID":"35493a67-ab1a-4c71-9158-3b0dae0be0a9","Type":"ContainerDied","Data":"21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066"} Jul 13 22:24:41.542842 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.542756 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd895d7c6-nrhlm" event={"ID":"35493a67-ab1a-4c71-9158-3b0dae0be0a9","Type":"ContainerDied","Data":"b32d895ec9504f63b9dd968132a3943726496caa91511cfc80b1c232d1418dd6"} Jul 13 22:24:41.542842 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.542775 2581 scope.go:117] "RemoveContainer" containerID="21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066" Jul 13 22:24:41.553011 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.552994 2581 scope.go:117] "RemoveContainer" containerID="21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066" Jul 13 22:24:41.553272 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:24:41.553254 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066\": container with ID starting with 21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066 not found: ID does not exist" containerID="21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066" Jul 13 22:24:41.553328 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.553280 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066"} err="failed to get container status \"21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066\": rpc error: code = NotFound desc = could not find container \"21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066\": container with ID starting with 21388600a63d0f6246fbecc6f6c936c20cfa614d498b8b9fe311212f29f88066 not found: ID does not exist" Jul 13 22:24:41.590119 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.590058 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd895d7c6-nrhlm"] Jul 13 22:24:41.596930 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.596907 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cd895d7c6-nrhlm"] Jul 13 22:24:41.908445 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:41.908351 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35493a67-ab1a-4c71-9158-3b0dae0be0a9" path="/var/lib/kubelet/pods/35493a67-ab1a-4c71-9158-3b0dae0be0a9/volumes" Jul 13 22:24:42.053107 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:42.053074 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:24:42.205870 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:24:42.205779 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:25:08.096255 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:25:08.096172 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:25:14.212435 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:25:14.212394 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:25:18.193916 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:25:18.193878 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:25:29.677404 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:25:29.677372 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:25:38.393264 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:25:38.393232 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:25:49.386980 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:25:49.386942 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:25:51.726799 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:25:51.726758 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:25:52.905149 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:25:52.905109 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:14.797841 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:14.794225 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:26:26.790436 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:26.790388 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:26:33.816143 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:33.816088 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:33.916124 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:33.916088 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:34.044565 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:34.044530 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:39.644317 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:39.644211 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:39.712662 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:39.712632 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:39.793007 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:39.792971 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:39.884000 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:39.883957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:40.000322 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:40.000277 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:45.639972 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:45.639939 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:45.822784 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:45.822747 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:51.682584 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:51.682533 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:26:51.734349 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:26:51.734316 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:27:01.278992 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:27:01.278952 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:27:10.382285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:27:10.382250 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:27:18.287499 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:27:18.287458 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:27:25.983134 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:27:25.983096 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:27:34.483203 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:27:34.483167 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:27:43.685942 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:27:43.685907 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:27:50.581498 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:27:50.581461 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:27:55.087398 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:27:55.087360 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:27:58.172386 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:27:58.172348 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:28:04.578440 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:28:04.578387 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:28:15.856976 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:28:15.856946 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:28:15.858095 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:28:15.858076 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:28:15.859282 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:28:15.859262 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:28:15.860319 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:28:15.860299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:28:30.380503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:28:30.380468 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:28:38.904141 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:28:38.904102 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:29:04.088094 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:29:04.088061 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:29:14.788169 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:29:14.788135 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:29:31.605536 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:29:31.605499 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:29:40.681516 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:29:40.681436 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:29:49.781054 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:29:49.781018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:29:59.483102 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:29:59.483068 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:30:01.219668 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:01.219638 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:30:02.881599 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:02.881565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:30:08.887340 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:08.887300 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:30:35.918787 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:35.918751 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq"] Jul 13 22:30:35.919261 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:35.918931 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" podUID="6cd57e4c-761f-4381-9ef0-f8ce6b3377cf" containerName="manager" containerID="cri-o://5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969" gracePeriod=10 Jul 13 22:30:39.476219 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.476196 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:30:39.534621 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.534594 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-extensions-socket-volume\") pod \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\" (UID: \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\") " Jul 13 22:30:39.534770 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.534694 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrwfw\" (UniqueName: \"kubernetes.io/projected/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-kube-api-access-lrwfw\") pod \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\" (UID: \"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf\") " Jul 13 22:30:39.535038 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.535012 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6cd57e4c-761f-4381-9ef0-f8ce6b3377cf" (UID: "6cd57e4c-761f-4381-9ef0-f8ce6b3377cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:30:39.536648 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.536616 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-kube-api-access-lrwfw" (OuterVolumeSpecName: "kube-api-access-lrwfw") pod "6cd57e4c-761f-4381-9ef0-f8ce6b3377cf" (UID: "6cd57e4c-761f-4381-9ef0-f8ce6b3377cf"). InnerVolumeSpecName "kube-api-access-lrwfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:30:39.543372 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.543335 2581 generic.go:356] "Generic (PLEG): container finished" podID="6cd57e4c-761f-4381-9ef0-f8ce6b3377cf" containerID="5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969" exitCode=0 Jul 13 22:30:39.543533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.543406 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" Jul 13 22:30:39.543533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.543415 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" event={"ID":"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf","Type":"ContainerDied","Data":"5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969"} Jul 13 22:30:39.543533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.543500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq" event={"ID":"6cd57e4c-761f-4381-9ef0-f8ce6b3377cf","Type":"ContainerDied","Data":"3875450f60a8ef80fafe95671cd75060f8747fd9049ca5628c20033dbc2667fd"} Jul 13 22:30:39.543533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.543528 2581 scope.go:117] "RemoveContainer" containerID="5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969" Jul 13 22:30:39.553472 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.553455 2581 scope.go:117] "RemoveContainer" containerID="5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969" Jul 13 22:30:39.553741 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:30:39.553721 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969\": container with ID starting with 5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969 not found: ID does not exist" containerID="5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969" Jul 13 22:30:39.553800 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.553749 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969"} err="failed to get container status \"5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969\": rpc error: code = NotFound desc = could not find container \"5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969\": container with ID starting with 5ef18a2bf3f4463be2ea435826fcfdf5435997dfcc4cfc4f3b390264ca107969 not found: ID does not exist" Jul 13 22:30:39.565292 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.565269 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq"] Jul 13 22:30:39.569248 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.569229 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tj9jq"] Jul 13 22:30:39.636285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.636228 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrwfw\" (UniqueName: \"kubernetes.io/projected/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-kube-api-access-lrwfw\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:30:39.636285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.636251 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf-extensions-socket-volume\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:30:39.907282 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:30:39.907188 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd57e4c-761f-4381-9ef0-f8ce6b3377cf" path="/var/lib/kubelet/pods/6cd57e4c-761f-4381-9ef0-f8ce6b3377cf/volumes" Jul 13 22:31:36.593680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:36.593640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:31:36.650741 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:36.650709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:31:37.101394 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.101365 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25"] Jul 13 22:31:37.101775 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.101761 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd57e4c-761f-4381-9ef0-f8ce6b3377cf" containerName="manager" Jul 13 22:31:37.101819 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.101776 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd57e4c-761f-4381-9ef0-f8ce6b3377cf" containerName="manager" Jul 13 22:31:37.101819 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.101790 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35493a67-ab1a-4c71-9158-3b0dae0be0a9" containerName="authorino" Jul 13 22:31:37.101819 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.101796 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="35493a67-ab1a-4c71-9158-3b0dae0be0a9" containerName="authorino" Jul 13 22:31:37.101919 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.101856 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="35493a67-ab1a-4c71-9158-3b0dae0be0a9" containerName="authorino" Jul 13 22:31:37.101919 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.101864 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd57e4c-761f-4381-9ef0-f8ce6b3377cf" containerName="manager" Jul 13 22:31:37.106090 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.106075 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:37.108192 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.108173 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-94xzr\"" Jul 13 22:31:37.121454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.121414 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25"] Jul 13 22:31:37.228395 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.228362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq47n\" (UniqueName: \"kubernetes.io/projected/6fffc6d7-147a-4d2a-81c6-73252334abd2-kube-api-access-tq47n\") pod \"kuadrant-operator-controller-manager-86878c769f-vsm25\" (UID: \"6fffc6d7-147a-4d2a-81c6-73252334abd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:37.228582 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.228454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fffc6d7-147a-4d2a-81c6-73252334abd2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vsm25\" (UID: \"6fffc6d7-147a-4d2a-81c6-73252334abd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:37.329037 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.329006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq47n\" (UniqueName: \"kubernetes.io/projected/6fffc6d7-147a-4d2a-81c6-73252334abd2-kube-api-access-tq47n\") pod \"kuadrant-operator-controller-manager-86878c769f-vsm25\" (UID: \"6fffc6d7-147a-4d2a-81c6-73252334abd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:37.329199 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.329064 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fffc6d7-147a-4d2a-81c6-73252334abd2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vsm25\" (UID: \"6fffc6d7-147a-4d2a-81c6-73252334abd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:37.329359 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.329335 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fffc6d7-147a-4d2a-81c6-73252334abd2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vsm25\" (UID: \"6fffc6d7-147a-4d2a-81c6-73252334abd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:37.337445 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.337404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq47n\" (UniqueName: \"kubernetes.io/projected/6fffc6d7-147a-4d2a-81c6-73252334abd2-kube-api-access-tq47n\") pod \"kuadrant-operator-controller-manager-86878c769f-vsm25\" (UID: \"6fffc6d7-147a-4d2a-81c6-73252334abd2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:37.416081 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.416017 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:37.549508 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.549483 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25"] Jul 13 22:31:37.551610 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:31:37.551587 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fffc6d7_147a_4d2a_81c6_73252334abd2.slice/crio-5f78e51cf036fc96c224fa4bda30ac26f9d31549400f9f170dbd05382745d5f9 WatchSource:0}: Error finding container 5f78e51cf036fc96c224fa4bda30ac26f9d31549400f9f170dbd05382745d5f9: Status 404 returned error can't find the container with id 5f78e51cf036fc96c224fa4bda30ac26f9d31549400f9f170dbd05382745d5f9 Jul 13 22:31:37.868737 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.868703 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" event={"ID":"6fffc6d7-147a-4d2a-81c6-73252334abd2","Type":"ContainerStarted","Data":"eeb69073f39082af7bfce9be2565fb2e0cf2fab9d845b8fe129e27894cc2a39f"} Jul 13 22:31:37.869099 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.868760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" event={"ID":"6fffc6d7-147a-4d2a-81c6-73252334abd2","Type":"ContainerStarted","Data":"5f78e51cf036fc96c224fa4bda30ac26f9d31549400f9f170dbd05382745d5f9"} Jul 13 22:31:37.869099 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.868782 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:37.888865 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:37.888819 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" podStartSLOduration=0.888804673 podStartE2EDuration="888.804673ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:31:37.886381392 +0000 UTC m=+1102.489657620" watchObservedRunningTime="2026-07-13 22:31:37.888804673 +0000 UTC m=+1102.492080900" Jul 13 22:31:48.877256 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:48.877218 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vsm25" Jul 13 22:31:56.689126 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:31:56.689091 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:32:08.686612 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:32:08.686576 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:32:17.583623 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:32:17.583580 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:32:25.790135 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:32:25.790098 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:32:34.781688 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:32:34.781653 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:32:44.903994 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:32:44.903915 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:32:55.180584 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:32:55.180545 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:33:05.885863 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:33:05.885824 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:33:15.285272 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:33:15.285232 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:33:15.892139 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:33:15.892107 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:33:15.894810 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:33:15.894785 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:33:15.895223 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:33:15.895204 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:33:15.897612 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:33:15.897591 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:33:26.573750 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:33:26.573712 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:33:38.181636 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:33:38.181602 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:33:45.691198 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:33:45.691168 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:34:03.181449 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:34:03.181400 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:34:12.485585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:34:12.485548 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:34:24.185680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:34:24.185644 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:34:32.983844 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:34:32.983816 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:34:42.779704 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:34:42.779660 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:34:59.085985 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:34:59.085942 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:35:08.575360 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:35:08.575324 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:35:17.774434 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:35:17.774389 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:35:28.380294 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:35:28.380257 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:35:37.208432 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:35:37.208340 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:35:46.477128 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:35:46.477090 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:36:01.290542 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:36:01.290506 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:36:10.750002 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:36:10.749962 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:36:10.910628 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:36:10.910583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:36:20.486692 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:36:20.486658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:36:21.578269 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:36:21.578234 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:36:32.888534 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:36:32.888497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:36:44.679961 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:36:44.679925 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:36:53.386075 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:36:53.386045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:37:04.882100 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:04.882066 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:37:07.413218 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:07.413136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:16.693693 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:16.693658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:37:27.683277 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:27.683217 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:37:29.006111 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:29.006075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:31.712999 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:31.712967 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:34.365016 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:34.364980 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:39.387462 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:39.387407 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:37:42.620802 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:42.620770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:47.722847 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:47.722805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:50.587349 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:50.587280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:50.689849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:50.689814 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:51.021552 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:51.021521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:51.388322 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:51.388238 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:37:56.654073 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:56.654039 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:56.755388 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:56.755358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:56.865231 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:56.865199 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:56.960390 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:56.960301 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:58.615017 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:58.614984 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:37:58.717084 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:37:58.717056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:00.369922 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:00.369885 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:01.503497 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:01.503462 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:38:03.120293 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:03.120260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:03.305194 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:03.305139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:03.409299 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:03.409221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:03.490312 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:03.490286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:04.512274 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:04.512246 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:09.718622 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:09.718582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:09.819993 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:09.819958 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:09.941070 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:09.941037 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:10.041335 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:10.041299 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:11.090953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:11.090920 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:11.198799 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:11.198766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:11.371720 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:11.371625 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:11.532739 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:11.532705 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:12.007678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:12.007645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:12.108099 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:12.108063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:12.885550 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:12.885511 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:38:13.152585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:13.152499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:15.934470 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:15.934438 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:38:15.937061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:15.937038 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:38:15.939622 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:15.939600 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:38:15.942541 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:15.942522 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:38:16.174383 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:16.174340 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:16.521671 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:16.521634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:22.272606 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:22.272569 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:22.373706 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:22.373667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:23.941129 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:23.941091 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:28.158483 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:28.158448 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:28.261689 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:28.261654 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:28.379197 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:28.379165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:28.444757 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:28.444681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:29.515813 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:29.515776 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:29.610854 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:29.610824 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:29.689497 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:29.689413 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:29.757665 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:29.757636 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:30.172943 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:30.172915 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:30.273935 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:30.273901 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:31.650221 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:31.650195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:32.284499 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:32.284472 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:38:33.930611 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:33.930581 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:34.114218 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:34.114185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:34.248137 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:34.248064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:34.348003 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:34.347975 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:35.484773 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:35.484727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:40.343382 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:40.343351 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:40.410176 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:40.410146 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:40.823935 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:40.823899 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:40.922014 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:40.921985 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:41.022624 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:41.022597 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:41.187435 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:41.187344 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:38:42.414878 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:42.414841 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:48.182690 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:48.182656 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:48.242970 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:48.242917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:48.316753 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:48.316716 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:48.416803 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:48.416773 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:48.516819 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:48.516775 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:38:48.920753 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:38:48.920678 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:14.919647 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:14.919604 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:20.721037 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:20.721007 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:20.789076 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:20.789048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:20.879354 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:20.879326 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:20.980992 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:20.980917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:36.869198 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:36.869161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:42.476743 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:42.476700 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:42.581045 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:42.581012 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:42.677108 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:42.677073 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:53.211925 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:53.211893 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:54.016684 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:54.016640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:59.717466 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:59.717406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:59.822982 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:59.822940 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:39:59.917623 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:39:59.917593 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:00.018215 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:00.018190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:00.856353 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:00.856321 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:00.945558 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:00.945520 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:01.047534 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:01.047503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:02.191018 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:02.190984 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:40:02.686528 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:02.686498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:08.223551 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:08.223446 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:08.325034 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:08.324996 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:08.903101 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:08.903073 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:11.185489 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:11.185449 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:40:14.780391 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:14.780346 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:14.882865 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:14.882822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:15.076636 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:15.076552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:15.357205 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:15.357117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:15.731247 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:15.731159 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:18.710829 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:18.710793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:18.795503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:18.795469 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:18.853268 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:18.853232 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:19.042277 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:19.042244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:19.374836 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:19.374741 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:19.475566 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:19.475535 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:23.264328 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:23.264286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:23.589113 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:23.589033 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:40:23.952477 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:23.952400 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:24.045700 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:24.045667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:24.377969 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:24.377929 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:29.962283 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:29.962249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:30.017926 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:30.017885 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:30.370701 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:30.370658 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:30.780342 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:30.780308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:30.884086 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:30.884055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:35.079794 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:35.079755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:40:36.943760 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:36.943720 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:37.047470 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:37.047410 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:37.221876 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:37.221802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:37.567218 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:37.567179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:37.668391 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:37.668355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:37.774315 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:37.774279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:43.735150 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:43.735115 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:43.838220 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:43.838183 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:43.935117 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:43.935076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:44.106877 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:44.106851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:49.729124 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:49.729071 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:49.831186 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:49.831132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:56.576593 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:56.576557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:56.897467 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:56.897329 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:57.084791 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:57.084760 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:59.879517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:59.879478 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:40:59.950982 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:40:59.950945 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:00.021944 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:00.021907 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:00.122245 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:00.122200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:00.526386 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:00.526353 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:00.627665 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:00.627619 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:04.395466 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:04.395414 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:04.675209 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:04.675134 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:41:13.670499 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:13.670459 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:14.700251 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:14.700218 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:21.236043 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:21.236006 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:21.333878 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:21.333841 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:37.689248 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.689171 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw"] Jul 13 22:41:37.693495 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.693475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.696564 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.696540 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6381cdd6\"/\"kube-root-ca.crt\"" Jul 13 22:41:37.696700 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.696545 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6381cdd6\"/\"e2e-lifecycle-model-6381cdd6-kserve-self-signed-certs\"" Jul 13 22:41:37.696700 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.696594 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6381cdd6\"/\"default-dockercfg-btrqz\"" Jul 13 22:41:37.696700 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.696594 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6381cdd6\"/\"openshift-service-ca.crt\"" Jul 13 22:41:37.702892 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.702873 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw"] Jul 13 22:41:37.719336 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.719313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:41:37.801594 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.801568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tmp-dir\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.801751 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.801599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tls-certs\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.801751 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.801627 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-home\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.801751 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.801647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-model-cache\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.801860 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.801767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-dshm\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.801860 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.801802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbgk7\" (UniqueName: \"kubernetes.io/projected/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-kube-api-access-kbgk7\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.902315 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.902284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-dshm\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.902315 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.902317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbgk7\" (UniqueName: \"kubernetes.io/projected/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-kube-api-access-kbgk7\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.902591 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.902349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tmp-dir\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.902591 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.902366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tls-certs\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.902591 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.902389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-home\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.902591 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.902493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-model-cache\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.902836 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.902815 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-home\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.902924 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.902838 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-model-cache\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.902924 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.902893 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tmp-dir\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.904908 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.904888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tls-certs\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.905016 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.904929 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-dshm\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:37.910347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:37.910319 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbgk7\" (UniqueName: \"kubernetes.io/projected/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-kube-api-access-kbgk7\") pod \"e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:38.003675 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:38.003641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:38.346683 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:38.346658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw"] Jul 13 22:41:38.348926 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:41:38.348900 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcf06408_f612_418c_a7a3_1e6e6dd8fedd.slice/crio-14f0e6a9ed0d47b6619736b5fd9e04f1958cb0bccc5d56559d11938cfc4e51c6 WatchSource:0}: Error finding container 14f0e6a9ed0d47b6619736b5fd9e04f1958cb0bccc5d56559d11938cfc4e51c6: Status 404 returned error can't find the container with id 14f0e6a9ed0d47b6619736b5fd9e04f1958cb0bccc5d56559d11938cfc4e51c6 Jul 13 22:41:39.257243 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:39.257204 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" event={"ID":"dcf06408-f612-418c-a7a3-1e6e6dd8fedd","Type":"ContainerStarted","Data":"626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5"} Jul 13 22:41:39.257243 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:39.257249 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" event={"ID":"dcf06408-f612-418c-a7a3-1e6e6dd8fedd","Type":"ContainerStarted","Data":"14f0e6a9ed0d47b6619736b5fd9e04f1958cb0bccc5d56559d11938cfc4e51c6"} Jul 13 22:41:39.274169 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:39.274111 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" podStartSLOduration=2.274096602 podStartE2EDuration="2.274096602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:41:39.273030882 +0000 UTC m=+1703.876307120" watchObservedRunningTime="2026-07-13 22:41:39.274096602 +0000 UTC m=+1703.877372829" Jul 13 22:41:41.280029 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:41.279993 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:41:48.004034 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:48.003991 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:48.004556 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:48.004054 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:48.016306 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:48.016284 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:41:48.318520 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:41:48.318447 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:42:00.078001 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:00.077970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:42:02.403264 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:02.403229 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:02.854377 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:02.854349 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:08.485035 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:08.485002 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:13.468871 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:13.468838 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw"] Jul 13 22:42:13.564275 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:13.564242 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:13.983338 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:13.983296 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:42:28.490545 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.490490 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" podUID="dcf06408-f612-418c-a7a3-1e6e6dd8fedd" containerName="main" containerID="cri-o://626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5" gracePeriod=45 Jul 13 22:42:28.741847 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.741792 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:42:28.835932 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.835902 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbgk7\" (UniqueName: \"kubernetes.io/projected/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-kube-api-access-kbgk7\") pod \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " Jul 13 22:42:28.836096 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.835954 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-home\") pod \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " Jul 13 22:42:28.836096 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.835980 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tmp-dir\") pod \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " Jul 13 22:42:28.836096 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.836012 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-model-cache\") pod \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " Jul 13 22:42:28.836096 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.836027 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-dshm\") pod \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " Jul 13 22:42:28.836096 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.836062 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tls-certs\") pod \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\" (UID: \"dcf06408-f612-418c-a7a3-1e6e6dd8fedd\") " Jul 13 22:42:28.836366 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.836286 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dcf06408-f612-418c-a7a3-1e6e6dd8fedd" (UID: "dcf06408-f612-418c-a7a3-1e6e6dd8fedd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:42:28.836366 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.836302 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-home" (OuterVolumeSpecName: "home") pod "dcf06408-f612-418c-a7a3-1e6e6dd8fedd" (UID: "dcf06408-f612-418c-a7a3-1e6e6dd8fedd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:42:28.836366 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.836314 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-model-cache" (OuterVolumeSpecName: "model-cache") pod "dcf06408-f612-418c-a7a3-1e6e6dd8fedd" (UID: "dcf06408-f612-418c-a7a3-1e6e6dd8fedd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:42:28.838240 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.838219 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-dshm" (OuterVolumeSpecName: "dshm") pod "dcf06408-f612-418c-a7a3-1e6e6dd8fedd" (UID: "dcf06408-f612-418c-a7a3-1e6e6dd8fedd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:42:28.838323 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.838230 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dcf06408-f612-418c-a7a3-1e6e6dd8fedd" (UID: "dcf06408-f612-418c-a7a3-1e6e6dd8fedd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:42:28.838323 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.838242 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-kube-api-access-kbgk7" (OuterVolumeSpecName: "kube-api-access-kbgk7") pod "dcf06408-f612-418c-a7a3-1e6e6dd8fedd" (UID: "dcf06408-f612-418c-a7a3-1e6e6dd8fedd"). InnerVolumeSpecName "kube-api-access-kbgk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:42:28.937633 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.937607 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-model-cache\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:42:28.937633 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.937630 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-dshm\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:42:28.937633 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.937640 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tls-certs\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:42:28.937833 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.937649 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbgk7\" (UniqueName: \"kubernetes.io/projected/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-kube-api-access-kbgk7\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:42:28.937833 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.937658 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-home\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:42:28.937833 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:28.937666 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dcf06408-f612-418c-a7a3-1e6e6dd8fedd-tmp-dir\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:42:29.536490 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.536457 2581 generic.go:356] "Generic (PLEG): container finished" podID="dcf06408-f612-418c-a7a3-1e6e6dd8fedd" containerID="626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5" exitCode=0 Jul 13 22:42:29.536972 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.536513 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" Jul 13 22:42:29.536972 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.536522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" event={"ID":"dcf06408-f612-418c-a7a3-1e6e6dd8fedd","Type":"ContainerDied","Data":"626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5"} Jul 13 22:42:29.536972 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.536554 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw" event={"ID":"dcf06408-f612-418c-a7a3-1e6e6dd8fedd","Type":"ContainerDied","Data":"14f0e6a9ed0d47b6619736b5fd9e04f1958cb0bccc5d56559d11938cfc4e51c6"} Jul 13 22:42:29.536972 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.536571 2581 scope.go:117] "RemoveContainer" containerID="626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5" Jul 13 22:42:29.546099 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.546082 2581 scope.go:117] "RemoveContainer" containerID="626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5" Jul 13 22:42:29.546340 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:42:29.546320 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5\": container with ID starting with 626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5 not found: ID does not exist" containerID="626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5" Jul 13 22:42:29.546411 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.546346 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5"} err="failed to get container status \"626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5\": rpc error: code = NotFound desc = could not find container \"626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5\": container with ID starting with 626b9fa70ffb7afff41486d0eb31e6850e3b3f89f683636c817987831b87c0d5 not found: ID does not exist" Jul 13 22:42:29.557118 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.557097 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw"] Jul 13 22:42:29.560854 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.560831 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6381cdd6/e2e-lifecycle-model-6381cdd6-kserve-8cdb55f99-rvqjw"] Jul 13 22:42:29.907676 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:29.907599 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf06408-f612-418c-a7a3-1e6e6dd8fedd" path="/var/lib/kubelet/pods/dcf06408-f612-418c-a7a3-1e6e6dd8fedd/volumes" Jul 13 22:42:50.410481 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:50.410451 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:50.599510 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:50.599469 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:52.989818 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:52.989784 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:42:56.101430 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:56.101390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:56.201404 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:56.201372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:56.391978 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:56.391900 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:57.682384 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:57.682336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:57.784961 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:57.784928 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:57.881600 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:57.881567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:58.708674 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:58.708634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:42:58.805925 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:42:58.805896 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:00.293022 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:00.292987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:05.678371 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:05.678339 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:43:06.073862 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:06.073825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:06.133039 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:06.133004 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:06.808125 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:06.808087 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:12.465377 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:12.465338 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:12.529791 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:12.529750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:12.622808 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:12.622760 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:12.843219 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:12.843185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:15.683358 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:15.683316 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:43:15.972119 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:15.972042 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:43:15.974389 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:15.974366 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:43:15.979863 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:15.979841 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:43:15.982180 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:15.982160 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:43:23.193576 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:23.193529 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:23.537213 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:23.537164 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:44.511038 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:44.511002 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:50.180960 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:50.180927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:50.239173 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:50.239146 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:50.532181 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:50.532132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:50.858073 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:50.857974 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:51.024619 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:51.024582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:53.681334 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:53.681296 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:53.771822 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:53.771795 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:53.865279 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:53.865247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:53.988865 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:53.988789 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:54.340866 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:54.340837 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:54.442067 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:54.442036 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:58.165779 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:58.165741 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:58.498655 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:58.498574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:58.875849 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:58.875817 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:43:59.028918 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:59.028881 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:43:59.109984 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:43:59.109947 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:01.716814 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:01.716781 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:01.808320 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:01.808286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:01.938974 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:01.938925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:02.273483 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:02.273443 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:02.635211 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:02.635131 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:02.740178 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:02.740150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:06.225052 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:06.225020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:07.281869 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:07.281838 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:44:16.183824 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:16.183785 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:16.284579 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:16.284543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:23.425684 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.425642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:23.522987 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.522947 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:23.694061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.693990 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb"] Jul 13 22:44:23.694403 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.694390 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf06408-f612-418c-a7a3-1e6e6dd8fedd" containerName="main" Jul 13 22:44:23.694479 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.694405 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf06408-f612-418c-a7a3-1e6e6dd8fedd" containerName="main" Jul 13 22:44:23.694517 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.694502 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf06408-f612-418c-a7a3-1e6e6dd8fedd" containerName="main" Jul 13 22:44:23.697645 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.697627 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.701080 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.701061 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6e7f3c\"/\"kube-root-ca.crt\"" Jul 13 22:44:23.701194 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.701085 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6e7f3c\"/\"test-model-6e7f3c-kserve-self-signed-certs\"" Jul 13 22:44:23.701194 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.701115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6e7f3c\"/\"default-dockercfg-r4sbm\"" Jul 13 22:44:23.701528 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.701514 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6e7f3c\"/\"openshift-service-ca.crt\"" Jul 13 22:44:23.741318 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.741288 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb"] Jul 13 22:44:23.794736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.794709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:23.826512 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.826484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/069aae25-5f7f-4016-b00a-c56d61f3a56a-tls-certs\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.826631 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.826515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-home\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.826631 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.826533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-model-cache\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.826631 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.826562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-dshm\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.826747 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.826708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-tmp-dir\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.826788 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.826758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msmxn\" (UniqueName: \"kubernetes.io/projected/069aae25-5f7f-4016-b00a-c56d61f3a56a-kube-api-access-msmxn\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.927499 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.927473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-tmp-dir\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.927638 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.927508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msmxn\" (UniqueName: \"kubernetes.io/projected/069aae25-5f7f-4016-b00a-c56d61f3a56a-kube-api-access-msmxn\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.927638 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.927582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/069aae25-5f7f-4016-b00a-c56d61f3a56a-tls-certs\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.927638 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.927609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-home\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.927638 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.927632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-model-cache\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.927865 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.927658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-dshm\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.927928 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.927902 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-tmp-dir\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.927993 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.927973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-home\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.928051 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.928035 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-model-cache\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.929946 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.929918 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-dshm\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.930211 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.930193 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/069aae25-5f7f-4016-b00a-c56d61f3a56a-tls-certs\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:23.937838 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:23.937819 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msmxn\" (UniqueName: \"kubernetes.io/projected/069aae25-5f7f-4016-b00a-c56d61f3a56a-kube-api-access-msmxn\") pod \"test-model-6e7f3c-kserve-557f459849-bqgwb\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:24.006917 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:24.006888 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:24.147287 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:24.147253 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb"] Jul 13 22:44:24.148800 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:44:24.148769 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod069aae25_5f7f_4016_b00a_c56d61f3a56a.slice/crio-50b6f77373997d018c1dcfd3c56e772531737ed6b4df654be510f5dcb277f238 WatchSource:0}: Error finding container 50b6f77373997d018c1dcfd3c56e772531737ed6b4df654be510f5dcb277f238: Status 404 returned error can't find the container with id 50b6f77373997d018c1dcfd3c56e772531737ed6b4df654be510f5dcb277f238 Jul 13 22:44:24.191771 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:24.191735 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" event={"ID":"069aae25-5f7f-4016-b00a-c56d61f3a56a","Type":"ContainerStarted","Data":"50b6f77373997d018c1dcfd3c56e772531737ed6b4df654be510f5dcb277f238"} Jul 13 22:44:25.198863 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:25.198829 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" event={"ID":"069aae25-5f7f-4016-b00a-c56d61f3a56a","Type":"ContainerStarted","Data":"a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a"} Jul 13 22:44:25.216210 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:25.216152 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" podStartSLOduration=2.216136328 podStartE2EDuration="2.216136328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:44:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:44:25.213732771 +0000 UTC m=+1869.817008997" watchObservedRunningTime="2026-07-13 22:44:25.216136328 +0000 UTC m=+1869.819412554" Jul 13 22:44:26.817710 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:26.817678 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:44:34.007039 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:34.007005 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:34.007452 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:34.007058 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:34.019402 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:34.019377 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:34.262479 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:34.262384 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:44:39.398487 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:39.398365 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:44:58.599236 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.599199 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq"] Jul 13 22:44:58.602834 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.602812 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.605867 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.605849 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-953e38\"/\"default-dockercfg-wgclv\"" Jul 13 22:44:58.606002 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.605871 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-953e38\"/\"openshift-service-ca.crt\"" Jul 13 22:44:58.606002 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.605892 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-953e38\"/\"kube-root-ca.crt\"" Jul 13 22:44:58.606002 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.605850 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-953e38\"/\"test-model-953e38-kserve-self-signed-certs\"" Jul 13 22:44:58.612657 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.612632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq"] Jul 13 22:44:58.633259 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.633230 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:44:58.716514 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.716484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-home\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.716659 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.716519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tls-certs\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.716659 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.716553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-model-cache\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.716659 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.716640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-dshm\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.716965 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.716695 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tmp-dir\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.716965 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.716721 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpqw4\" (UniqueName: \"kubernetes.io/projected/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-kube-api-access-vpqw4\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.817612 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.817578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-home\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.817612 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.817611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tls-certs\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.817799 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.817634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-model-cache\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.817799 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.817688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-dshm\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.817799 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.817734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tmp-dir\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.817799 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.817765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqw4\" (UniqueName: \"kubernetes.io/projected/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-kube-api-access-vpqw4\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.818104 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.818080 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-model-cache\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.818187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.818114 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-home\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.818187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.818138 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tmp-dir\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.820033 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.820012 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-dshm\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.820166 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.820148 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tls-certs\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.825601 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.825578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpqw4\" (UniqueName: \"kubernetes.io/projected/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-kube-api-access-vpqw4\") pod \"test-model-953e38-kserve-5987bbfc55-nx4zq\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:58.913927 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:58.913853 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:44:59.054357 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:59.053961 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq"] Jul 13 22:44:59.055107 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:44:59.054828 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b73c9fc_9a27_4785_86b0_1ab37fbdcfc6.slice/crio-7f2259d5bdc5a82f1e7bccf49ab279b7563c54fd464bef12ab7182ce28b2949d WatchSource:0}: Error finding container 7f2259d5bdc5a82f1e7bccf49ab279b7563c54fd464bef12ab7182ce28b2949d: Status 404 returned error can't find the container with id 7f2259d5bdc5a82f1e7bccf49ab279b7563c54fd464bef12ab7182ce28b2949d Jul 13 22:44:59.401356 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:59.401310 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" event={"ID":"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6","Type":"ContainerStarted","Data":"ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb"} Jul 13 22:44:59.401580 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:59.401364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" event={"ID":"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6","Type":"ContainerStarted","Data":"7f2259d5bdc5a82f1e7bccf49ab279b7563c54fd464bef12ab7182ce28b2949d"} Jul 13 22:44:59.420018 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:44:59.419975 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" podStartSLOduration=1.419959669 podStartE2EDuration="1.419959669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:44:59.417379198 +0000 UTC m=+1904.020655426" watchObservedRunningTime="2026-07-13 22:44:59.419959669 +0000 UTC m=+1904.023235895" Jul 13 22:45:03.130171 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:03.130136 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:45:08.914986 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:08.914944 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:45:08.915380 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:08.915133 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:45:08.928124 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:08.928096 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:45:09.471572 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:09.471544 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:45:20.236166 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:20.236128 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb"] Jul 13 22:45:20.255278 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:20.255246 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:45:21.271939 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:21.271755 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq"] Jul 13 22:45:21.276950 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:21.276920 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:45:21.420285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:21.420255 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:45:21.835448 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:21.835390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:45:21.935433 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:21.935378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:45:22.118454 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:22.118353 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:45:26.477597 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:26.477568 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:45:26.912881 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:26.912847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:45:35.256467 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.256414 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" podUID="069aae25-5f7f-4016-b00a-c56d61f3a56a" containerName="main" containerID="cri-o://a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a" gracePeriod=45 Jul 13 22:45:35.512003 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.511950 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:45:35.612401 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.612367 2581 generic.go:356] "Generic (PLEG): container finished" podID="069aae25-5f7f-4016-b00a-c56d61f3a56a" containerID="a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a" exitCode=0 Jul 13 22:45:35.612555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.612404 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" Jul 13 22:45:35.612555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.612451 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" event={"ID":"069aae25-5f7f-4016-b00a-c56d61f3a56a","Type":"ContainerDied","Data":"a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a"} Jul 13 22:45:35.612555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.612490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb" event={"ID":"069aae25-5f7f-4016-b00a-c56d61f3a56a","Type":"ContainerDied","Data":"50b6f77373997d018c1dcfd3c56e772531737ed6b4df654be510f5dcb277f238"} Jul 13 22:45:35.612555 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.612511 2581 scope.go:117] "RemoveContainer" containerID="a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a" Jul 13 22:45:35.621548 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.621503 2581 scope.go:117] "RemoveContainer" containerID="a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a" Jul 13 22:45:35.621769 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:45:35.621752 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a\": container with ID starting with a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a not found: ID does not exist" containerID="a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a" Jul 13 22:45:35.621818 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.621777 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a"} err="failed to get container status \"a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a\": rpc error: code = NotFound desc = could not find container \"a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a\": container with ID starting with a2af134e7585a54b0c12f46146758610aa575376c46b42c5b999857775aa573a not found: ID does not exist" Jul 13 22:45:35.659097 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659073 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-home\") pod \"069aae25-5f7f-4016-b00a-c56d61f3a56a\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " Jul 13 22:45:35.659216 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659126 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/069aae25-5f7f-4016-b00a-c56d61f3a56a-tls-certs\") pod \"069aae25-5f7f-4016-b00a-c56d61f3a56a\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " Jul 13 22:45:35.659216 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659154 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msmxn\" (UniqueName: \"kubernetes.io/projected/069aae25-5f7f-4016-b00a-c56d61f3a56a-kube-api-access-msmxn\") pod \"069aae25-5f7f-4016-b00a-c56d61f3a56a\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " Jul 13 22:45:35.659216 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659186 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-tmp-dir\") pod \"069aae25-5f7f-4016-b00a-c56d61f3a56a\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " Jul 13 22:45:35.659375 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659230 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-dshm\") pod \"069aae25-5f7f-4016-b00a-c56d61f3a56a\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " Jul 13 22:45:35.659375 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659263 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-model-cache\") pod \"069aae25-5f7f-4016-b00a-c56d61f3a56a\" (UID: \"069aae25-5f7f-4016-b00a-c56d61f3a56a\") " Jul 13 22:45:35.659375 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659335 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-home" (OuterVolumeSpecName: "home") pod "069aae25-5f7f-4016-b00a-c56d61f3a56a" (UID: "069aae25-5f7f-4016-b00a-c56d61f3a56a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:45:35.659574 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659516 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "069aae25-5f7f-4016-b00a-c56d61f3a56a" (UID: "069aae25-5f7f-4016-b00a-c56d61f3a56a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:45:35.659574 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659552 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-model-cache" (OuterVolumeSpecName: "model-cache") pod "069aae25-5f7f-4016-b00a-c56d61f3a56a" (UID: "069aae25-5f7f-4016-b00a-c56d61f3a56a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:45:35.659663 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659629 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-home\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:35.659699 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659663 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-tmp-dir\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:35.659699 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.659675 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-model-cache\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:35.661404 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.661376 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/069aae25-5f7f-4016-b00a-c56d61f3a56a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "069aae25-5f7f-4016-b00a-c56d61f3a56a" (UID: "069aae25-5f7f-4016-b00a-c56d61f3a56a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:45:35.661534 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.661399 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-dshm" (OuterVolumeSpecName: "dshm") pod "069aae25-5f7f-4016-b00a-c56d61f3a56a" (UID: "069aae25-5f7f-4016-b00a-c56d61f3a56a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:45:35.661534 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.661481 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/069aae25-5f7f-4016-b00a-c56d61f3a56a-kube-api-access-msmxn" (OuterVolumeSpecName: "kube-api-access-msmxn") pod "069aae25-5f7f-4016-b00a-c56d61f3a56a" (UID: "069aae25-5f7f-4016-b00a-c56d61f3a56a"). InnerVolumeSpecName "kube-api-access-msmxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:45:35.760248 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.760222 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/069aae25-5f7f-4016-b00a-c56d61f3a56a-dshm\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:35.760248 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.760245 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/069aae25-5f7f-4016-b00a-c56d61f3a56a-tls-certs\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:35.760411 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.760256 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msmxn\" (UniqueName: \"kubernetes.io/projected/069aae25-5f7f-4016-b00a-c56d61f3a56a-kube-api-access-msmxn\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:35.932343 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.932306 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb"] Jul 13 22:45:35.936002 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:35.935983 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6e7f3c/test-model-6e7f3c-kserve-557f459849-bqgwb"] Jul 13 22:45:36.292786 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.292736 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" podUID="7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" containerName="main" containerID="cri-o://ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb" gracePeriod=45 Jul 13 22:45:36.564316 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.564291 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:45:36.620058 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.620031 2581 generic.go:356] "Generic (PLEG): container finished" podID="7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" containerID="ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb" exitCode=0 Jul 13 22:45:36.620187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.620068 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" Jul 13 22:45:36.620187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.620063 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" event={"ID":"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6","Type":"ContainerDied","Data":"ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb"} Jul 13 22:45:36.620187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.620164 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq" event={"ID":"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6","Type":"ContainerDied","Data":"7f2259d5bdc5a82f1e7bccf49ab279b7563c54fd464bef12ab7182ce28b2949d"} Jul 13 22:45:36.620187 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.620182 2581 scope.go:117] "RemoveContainer" containerID="ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb" Jul 13 22:45:36.630379 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.630363 2581 scope.go:117] "RemoveContainer" containerID="ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb" Jul 13 22:45:36.630691 ip-10-0-137-241 kubenswrapper[2581]: E0713 22:45:36.630673 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb\": container with ID starting with ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb not found: ID does not exist" containerID="ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb" Jul 13 22:45:36.630744 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.630700 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb"} err="failed to get container status \"ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb\": rpc error: code = NotFound desc = could not find container \"ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb\": container with ID starting with ea07fa65ed12bb70222aa46ce70caf760aad629db504fb3a36084e5fe4cccdcb not found: ID does not exist" Jul 13 22:45:36.668965 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.668947 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpqw4\" (UniqueName: \"kubernetes.io/projected/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-kube-api-access-vpqw4\") pod \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " Jul 13 22:45:36.669060 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.669013 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-dshm\") pod \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " Jul 13 22:45:36.669060 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.669032 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-model-cache\") pod \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " Jul 13 22:45:36.669164 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.669066 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tls-certs\") pod \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " Jul 13 22:45:36.669164 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.669100 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-home\") pod \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " Jul 13 22:45:36.669164 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.669118 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tmp-dir\") pod \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\" (UID: \"7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6\") " Jul 13 22:45:36.669350 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.669318 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-model-cache" (OuterVolumeSpecName: "model-cache") pod "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" (UID: "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:45:36.669437 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.669367 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-home" (OuterVolumeSpecName: "home") pod "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" (UID: "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:45:36.669488 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.669443 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" (UID: "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:45:36.671122 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.671096 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-dshm" (OuterVolumeSpecName: "dshm") pod "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" (UID: "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 22:45:36.671210 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.671149 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-kube-api-access-vpqw4" (OuterVolumeSpecName: "kube-api-access-vpqw4") pod "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" (UID: "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6"). InnerVolumeSpecName "kube-api-access-vpqw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 22:45:36.671210 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.671180 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" (UID: "7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 22:45:36.770672 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.770644 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tls-certs\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:36.770672 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.770669 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-home\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:36.770672 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.770679 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-tmp-dir\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:36.770884 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.770688 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpqw4\" (UniqueName: \"kubernetes.io/projected/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-kube-api-access-vpqw4\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:36.770884 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.770697 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-dshm\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:36.770884 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.770706 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6-model-cache\") on node \"ip-10-0-137-241.ec2.internal\" DevicePath \"\"" Jul 13 22:45:36.940630 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.940582 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq"] Jul 13 22:45:36.944533 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:36.944509 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-953e38/test-model-953e38-kserve-5987bbfc55-nx4zq"] Jul 13 22:45:37.908159 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:37.908123 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="069aae25-5f7f-4016-b00a-c56d61f3a56a" path="/var/lib/kubelet/pods/069aae25-5f7f-4016-b00a-c56d61f3a56a/volumes" Jul 13 22:45:37.908539 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:37.908524 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" path="/var/lib/kubelet/pods/7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6/volumes" Jul 13 22:45:47.572799 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:47.572764 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:45:47.621573 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:47.621544 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:45:52.907703 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:45:52.907665 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:03.573597 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:03.573557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:03.842260 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:03.842176 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:04.334239 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:04.334200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:04.713338 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:04.713255 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:04.813513 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:04.813478 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:04.915146 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:04.915114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:05.045493 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:05.045457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:07.932407 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:07.932333 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:46:10.567754 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:10.567717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:10.667736 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:10.667699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:10.888682 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:10.888604 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:11.421184 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:11.421148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:11.740110 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:11.740017 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:11.935614 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:11.935583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:14.243960 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:14.243918 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:14.338214 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:14.338181 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:14.438040 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:14.437998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:14.542044 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:14.542008 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:14.778031 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:14.778000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:16.045571 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:16.045535 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:18.736947 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:18.736911 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:19.022742 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:19.022706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:46:19.203539 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:19.203505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:19.533902 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:19.533873 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:19.846824 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:19.846737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:22.278880 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:22.278842 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:22.383673 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:22.383631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:22.491876 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:22.491847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:22.614501 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:22.614402 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:22.924168 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:22.924074 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:22.991336 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:22.991303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:26.828503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:26.828473 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:30.392435 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:30.392381 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:46:34.887148 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:34.887114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:35.294034 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:35.293992 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:35.393886 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:35.393856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:35.495161 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:35.495130 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:35.649846 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:35.649764 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:41.405630 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:41.405591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:41.532577 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:41.532549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:41.658760 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:41.658684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:42.050506 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:42.050472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:42.480089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:42.480008 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:42.579953 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:42.579925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:42.683516 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:42.683485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:42.860345 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:42.860304 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:46.189848 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:46.189816 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:46:48.369367 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:48.369333 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:48.469781 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:48.469754 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:48.632775 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:48.632696 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:49.203181 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:49.203151 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:49.521375 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:49.521348 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:49.910981 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:49.910899 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:52.487513 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:52.487468 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:52.573995 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:52.573961 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:52.650016 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:52.649982 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:52.933651 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:52.933610 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:53.058329 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:53.058297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:53.159795 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:53.159764 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:56.970201 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:56.970165 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:57.307929 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:57.307895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:57.382467 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:57.382437 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:46:57.701690 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:57.701618 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:46:57.778076 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:46:57.778049 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:00.514025 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:00.513996 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:00.602433 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:00.602395 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:00.773904 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:00.773819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:01.170676 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:01.170601 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:01.335621 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:01.335590 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:01.435403 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:01.435330 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:05.009888 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:05.009851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:05.996940 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:05.996899 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:47:13.830569 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:13.830524 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:13.932118 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:13.932084 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:14.259235 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:14.259204 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:22.135717 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:22.135683 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:47:22.235949 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:47:22.235919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:48:16.008216 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:48:16.008187 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:48:16.010678 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:48:16.010658 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:48:16.017851 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:48:16.017826 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:48:16.020236 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:48:16.020216 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vskgc_d2901cbd-37b2-4230-9412-77025b60a56e/ovn-acl-logging/0.log" Jul 13 22:50:10.085791 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:10.085758 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:10.485160 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:10.485073 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:10.586134 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:10.586104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:10.687804 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:10.687774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:10.760615 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:10.760585 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:13.785564 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:13.785524 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:50:16.345541 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:16.345504 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:16.416063 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:16.416027 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:16.610173 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:16.610078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:16.997593 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:16.997509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:17.405663 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:17.405623 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:17.506453 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:17.506387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:17.611586 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:17.611548 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:17.735497 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:17.735383 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:23.141261 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:23.141225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:23.217758 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:23.217709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:23.425182 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:23.425076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:25.581967 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:25.581935 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rntt8"] Jul 13 22:50:28.849809 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:28.849770 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zjss2_a592c933-bc86-4649-ba91-629c3be8fc49/manager/0.log" Jul 13 22:50:28.967866 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:28.967831 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x6zkd_ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8/manager/0.log" Jul 13 22:50:29.206481 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:29.206390 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w7tvz_accb3645-de69-4da9-8af3-367fd144dd36/server/0.log" Jul 13 22:50:29.324700 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:29.324668 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kw5q2_dde19b41-3b72-44a8-8d21-b2d560ba7071/manager/0.log" Jul 13 22:50:29.452267 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:29.452233 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5bf5468b-6b67g_dfb66788-ff43-438a-819e-ee9ae4088d4a/manager/0.log" Jul 13 22:50:29.460212 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:29.460155 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5bf5468b-6b67g_dfb66788-ff43-438a-819e-ee9ae4088d4a/copy-manifests/0.log" Jul 13 22:50:30.484756 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.484729 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm_9534e13b-85a8-4521-82ce-2cae5bf46356/extract/0.log" Jul 13 22:50:30.490746 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.490725 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm_9534e13b-85a8-4521-82ce-2cae5bf46356/util/0.log" Jul 13 22:50:30.497292 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.497275 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm_9534e13b-85a8-4521-82ce-2cae5bf46356/pull/0.log" Jul 13 22:50:30.610951 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.610930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6_51c7970c-23c4-4088-8e8d-97e5f4f03f4a/util/0.log" Jul 13 22:50:30.620409 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.620391 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6_51c7970c-23c4-4088-8e8d-97e5f4f03f4a/pull/0.log" Jul 13 22:50:30.628286 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.628245 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6_51c7970c-23c4-4088-8e8d-97e5f4f03f4a/extract/0.log" Jul 13 22:50:30.742877 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.742816 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn_b72f62ca-c6ba-4da5-bcc3-5e05211a82c6/util/0.log" Jul 13 22:50:30.749807 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.749786 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn_b72f62ca-c6ba-4da5-bcc3-5e05211a82c6/pull/0.log" Jul 13 22:50:30.756815 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.756775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn_b72f62ca-c6ba-4da5-bcc3-5e05211a82c6/extract/0.log" Jul 13 22:50:30.865414 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.865382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f_8abb5381-d256-41bf-891f-1db5fe79d884/extract/0.log" Jul 13 22:50:30.871004 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.870983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f_8abb5381-d256-41bf-891f-1db5fe79d884/util/0.log" Jul 13 22:50:30.876747 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:30.876731 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f_8abb5381-d256-41bf-891f-1db5fe79d884/pull/0.log" Jul 13 22:50:31.118055 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:31.118029 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n8hmb_d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea/manager/0.log" Jul 13 22:50:31.230963 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:31.230924 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vqhsk_5bc092a1-70a2-46ae-b65f-2842676b26c5/manager/0.log" Jul 13 22:50:31.342388 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:31.342361 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jjlv4_a2e960f6-ac9d-4697-b976-c66a2a34b91b/kuadrant-console-plugin/0.log" Jul 13 22:50:31.466158 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:31.466078 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7vps6_9b8afbc8-b9ca-4732-8dea-1a1abe0713f3/registry-server/0.log" Jul 13 22:50:31.585127 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:31.585087 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vsm25_6fffc6d7-147a-4d2a-81c6-73252334abd2/manager/0.log" Jul 13 22:50:31.701503 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:31.701477 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rntt8_bac5bc12-2c80-4d97-a462-0714f5f758e2/limitador/0.log" Jul 13 22:50:31.831918 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:31.831891 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n6chv_41f85b25-311b-4158-a368-5cc24bcad099/manager/0.log" Jul 13 22:50:32.531562 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:32.531527 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67f58f88b6-nnmpp_010f49e0-93f7-49d9-b7ae-f0a740745eb1/kube-auth-proxy/0.log" Jul 13 22:50:33.024188 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:33.024162 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5957f79d44-8gl4v_265ffc2b-2b91-406a-8533-4584e155db46/router/0.log" Jul 13 22:50:33.712211 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:33.712175 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5598_6758b3e5-e671-42e9-84a4-178a3a6f8a4b/main/0.log" Jul 13 22:50:33.936776 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:33.936738 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-5w4dm_5602b3b5-6c3f-49d8-930c-4bc3d67f147a/main/0.log" Jul 13 22:50:38.144912 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.144833 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g7vdh/must-gather-x5xgq"] Jul 13 22:50:38.145286 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.145271 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069aae25-5f7f-4016-b00a-c56d61f3a56a" containerName="main" Jul 13 22:50:38.145339 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.145288 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="069aae25-5f7f-4016-b00a-c56d61f3a56a" containerName="main" Jul 13 22:50:38.145339 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.145296 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" containerName="main" Jul 13 22:50:38.145339 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.145301 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" containerName="main" Jul 13 22:50:38.145461 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.145378 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="069aae25-5f7f-4016-b00a-c56d61f3a56a" containerName="main" Jul 13 22:50:38.145461 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.145385 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b73c9fc-9a27-4785-86b0-1ab37fbdcfc6" containerName="main" Jul 13 22:50:38.148716 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.148695 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g7vdh/must-gather-x5xgq" Jul 13 22:50:38.150798 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.150781 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g7vdh\"/\"openshift-service-ca.crt\"" Jul 13 22:50:38.150886 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.150866 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g7vdh\"/\"kube-root-ca.crt\"" Jul 13 22:50:38.151322 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.151307 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g7vdh\"/\"default-dockercfg-c6x79\"" Jul 13 22:50:38.157010 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.156986 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g7vdh/must-gather-x5xgq"] Jul 13 22:50:38.169491 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.169468 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:38.224292 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.224268 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:50:38.256635 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.256602 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6482ae78-8af0-4210-b9cb-64bc8ebdc524-must-gather-output\") pod \"must-gather-x5xgq\" (UID: \"6482ae78-8af0-4210-b9cb-64bc8ebdc524\") " pod="openshift-must-gather-g7vdh/must-gather-x5xgq" Jul 13 22:50:38.256635 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.256640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkmvv\" (UniqueName: \"kubernetes.io/projected/6482ae78-8af0-4210-b9cb-64bc8ebdc524-kube-api-access-fkmvv\") pod \"must-gather-x5xgq\" (UID: \"6482ae78-8af0-4210-b9cb-64bc8ebdc524\") " pod="openshift-must-gather-g7vdh/must-gather-x5xgq" Jul 13 22:50:38.357309 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.357283 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6482ae78-8af0-4210-b9cb-64bc8ebdc524-must-gather-output\") pod \"must-gather-x5xgq\" (UID: \"6482ae78-8af0-4210-b9cb-64bc8ebdc524\") " pod="openshift-must-gather-g7vdh/must-gather-x5xgq" Jul 13 22:50:38.357309 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.357310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkmvv\" (UniqueName: \"kubernetes.io/projected/6482ae78-8af0-4210-b9cb-64bc8ebdc524-kube-api-access-fkmvv\") pod \"must-gather-x5xgq\" (UID: \"6482ae78-8af0-4210-b9cb-64bc8ebdc524\") " pod="openshift-must-gather-g7vdh/must-gather-x5xgq" Jul 13 22:50:38.357680 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.357658 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6482ae78-8af0-4210-b9cb-64bc8ebdc524-must-gather-output\") pod \"must-gather-x5xgq\" (UID: \"6482ae78-8af0-4210-b9cb-64bc8ebdc524\") " pod="openshift-must-gather-g7vdh/must-gather-x5xgq" Jul 13 22:50:38.364841 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.364820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkmvv\" (UniqueName: \"kubernetes.io/projected/6482ae78-8af0-4210-b9cb-64bc8ebdc524-kube-api-access-fkmvv\") pod \"must-gather-x5xgq\" (UID: \"6482ae78-8af0-4210-b9cb-64bc8ebdc524\") " pod="openshift-must-gather-g7vdh/must-gather-x5xgq" Jul 13 22:50:38.458502 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.458409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g7vdh/must-gather-x5xgq" Jul 13 22:50:38.588509 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.588482 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g7vdh/must-gather-x5xgq"] Jul 13 22:50:38.591123 ip-10-0-137-241 kubenswrapper[2581]: W0713 22:50:38.591098 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6482ae78_8af0_4210_b9cb_64bc8ebdc524.slice/crio-1f606758eb2b8011e1e60179f84cda41969abfed73a5f33f6a62582ee1eae9dd WatchSource:0}: Error finding container 1f606758eb2b8011e1e60179f84cda41969abfed73a5f33f6a62582ee1eae9dd: Status 404 returned error can't find the container with id 1f606758eb2b8011e1e60179f84cda41969abfed73a5f33f6a62582ee1eae9dd Jul 13 22:50:38.593056 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:38.593040 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 22:50:39.332463 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:39.332405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g7vdh/must-gather-x5xgq" event={"ID":"6482ae78-8af0-4210-b9cb-64bc8ebdc524","Type":"ContainerStarted","Data":"1f606758eb2b8011e1e60179f84cda41969abfed73a5f33f6a62582ee1eae9dd"} Jul 13 22:50:40.341167 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:40.341127 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g7vdh/must-gather-x5xgq" event={"ID":"6482ae78-8af0-4210-b9cb-64bc8ebdc524","Type":"ContainerStarted","Data":"a2f0cef6374069449dd11b6956ab11b92e9c84f666f74c519982a1ab48bfd184"} Jul 13 22:50:40.341864 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:40.341840 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g7vdh/must-gather-x5xgq" event={"ID":"6482ae78-8af0-4210-b9cb-64bc8ebdc524","Type":"ContainerStarted","Data":"0df7760191a5064f22ba96828f4c00066b53e577bb289d556078f1511f62937c"} Jul 13 22:50:40.358737 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:40.358674 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g7vdh/must-gather-x5xgq" podStartSLOduration=1.471371306 podStartE2EDuration="2.358654562s" totalImagesPullingTime="887.283256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:50:40.355357356 +0000 UTC m=+2244.958633584" watchObservedRunningTime="2026-07-13 22:50:40.358654562 +0000 UTC m=+2244.961930791" Jul 13 22:50:41.002311 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:41.002284 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cvb5k_eec1a835-7c98-41a2-971f-39390a54adf3/global-pull-secret-syncer/0.log" Jul 13 22:50:41.095617 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:41.095583 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" Jul 13 22:50:41.248074 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:41.248043 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-241.ec2.internal_61ba569156a29f0398951f103cb13f1d/haproxy/0.log" Jul 13 22:50:45.366901 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.366873 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm_9534e13b-85a8-4521-82ce-2cae5bf46356/extract/0.log" Jul 13 22:50:45.391486 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.391455 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm_9534e13b-85a8-4521-82ce-2cae5bf46356/util/0.log" Jul 13 22:50:45.413040 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.412992 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pxpzm_9534e13b-85a8-4521-82ce-2cae5bf46356/pull/0.log" Jul 13 22:50:45.456215 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.456186 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6_51c7970c-23c4-4088-8e8d-97e5f4f03f4a/extract/0.log" Jul 13 22:50:45.482941 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.482915 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6_51c7970c-23c4-4088-8e8d-97e5f4f03f4a/util/0.log" Jul 13 22:50:45.506409 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.506383 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fsml6_51c7970c-23c4-4088-8e8d-97e5f4f03f4a/pull/0.log" Jul 13 22:50:45.534299 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.534253 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn_b72f62ca-c6ba-4da5-bcc3-5e05211a82c6/extract/0.log" Jul 13 22:50:45.553798 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.553771 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn_b72f62ca-c6ba-4da5-bcc3-5e05211a82c6/util/0.log" Jul 13 22:50:45.575585 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.575556 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73pkrcn_b72f62ca-c6ba-4da5-bcc3-5e05211a82c6/pull/0.log" Jul 13 22:50:45.601925 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.601897 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f_8abb5381-d256-41bf-891f-1db5fe79d884/extract/0.log" Jul 13 22:50:45.626848 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.626777 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f_8abb5381-d256-41bf-891f-1db5fe79d884/util/0.log" Jul 13 22:50:45.652700 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:45.652667 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qf89f_8abb5381-d256-41bf-891f-1db5fe79d884/pull/0.log" Jul 13 22:50:46.146439 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:46.146390 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n8hmb_d4df5da7-5318-4339-a8ec-5dcdbbeeb3ea/manager/0.log" Jul 13 22:50:46.175201 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:46.175171 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vqhsk_5bc092a1-70a2-46ae-b65f-2842676b26c5/manager/0.log" Jul 13 22:50:46.201523 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:46.201477 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jjlv4_a2e960f6-ac9d-4697-b976-c66a2a34b91b/kuadrant-console-plugin/0.log" Jul 13 22:50:46.242412 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:46.242383 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7vps6_9b8afbc8-b9ca-4732-8dea-1a1abe0713f3/registry-server/0.log" Jul 13 22:50:46.376894 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:46.376751 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vsm25_6fffc6d7-147a-4d2a-81c6-73252334abd2/manager/0.log" Jul 13 22:50:46.401684 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:46.401610 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rntt8_bac5bc12-2c80-4d97-a462-0714f5f758e2/limitador/0.log" Jul 13 22:50:46.476064 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:46.476034 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n6chv_41f85b25-311b-4158-a368-5cc24bcad099/manager/0.log" Jul 13 22:50:48.416797 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:48.416769 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-pkzgr_0c51dc89-77fb-438b-942b-9dc59ea1b869/cluster-monitoring-operator/0.log" Jul 13 22:50:48.662634 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:48.662602 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fh9zf_dcfb3347-e15c-41eb-86ac-1b314a11844a/node-exporter/0.log" Jul 13 22:50:48.682809 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:48.682726 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fh9zf_dcfb3347-e15c-41eb-86ac-1b314a11844a/kube-rbac-proxy/0.log" Jul 13 22:50:48.702088 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:48.702060 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fh9zf_dcfb3347-e15c-41eb-86ac-1b314a11844a/init-textfile/0.log" Jul 13 22:50:50.470309 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:50.470278 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-8xqrn_03b29cad-a516-474c-a034-83c7db33f1a8/networking-console-plugin/0.log" Jul 13 22:50:51.041470 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.041406 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489"] Jul 13 22:50:51.045510 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.045486 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.053740 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.053718 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489"] Jul 13 22:50:51.096690 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.096650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-sys\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.096870 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.096751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-lib-modules\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.096870 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.096778 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-podres\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.096870 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.096795 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxh7f\" (UniqueName: \"kubernetes.io/projected/2f19b233-0051-4ec8-b8de-2193630937e6-kube-api-access-nxh7f\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.096870 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.096826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-proc\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.116992 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.116956 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/1.log" Jul 13 22:50:51.124462 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.124407 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6qmcp_3250ec47-e688-4bfb-9453-83722d21174c/console-operator/2.log" Jul 13 22:50:51.198113 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.198064 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-lib-modules\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.198113 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.198127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-podres\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.198394 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.198154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxh7f\" (UniqueName: \"kubernetes.io/projected/2f19b233-0051-4ec8-b8de-2193630937e6-kube-api-access-nxh7f\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.198394 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.198192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-proc\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.198394 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.198279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-sys\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.198394 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.198390 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-sys\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.198652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.198552 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-lib-modules\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.198652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.198648 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-podres\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.199019 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.198994 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f19b233-0051-4ec8-b8de-2193630937e6-proc\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.208895 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.208860 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxh7f\" (UniqueName: \"kubernetes.io/projected/2f19b233-0051-4ec8-b8de-2193630937e6-kube-api-access-nxh7f\") pod \"perf-node-gather-daemonset-bg489\" (UID: \"2f19b233-0051-4ec8-b8de-2193630937e6\") " pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.376569 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.376483 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:51.567090 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.567053 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489"] Jul 13 22:50:51.708735 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.708706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58c7f8d57b-lbhdc_95a08a57-a1a7-44f1-9fe6-2e76dab39e95/console/0.log" Jul 13 22:50:51.743642 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:51.743609 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-pgrjd_d64f3a9a-85e2-4452-b491-f3ee90e74ebf/download-server/0.log" Jul 13 22:50:52.340452 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:52.340410 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-gt6zp_4ef2e39a-c1e8-45aa-8494-b64ddf8faa3a/volume-data-source-validator/0.log" Jul 13 22:50:52.450898 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:52.450852 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" event={"ID":"2f19b233-0051-4ec8-b8de-2193630937e6","Type":"ContainerStarted","Data":"803a5007b74253364848d0ad950c5c624f7c206a8005abaa15c349ffc7e1539b"} Jul 13 22:50:52.451089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:52.450928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" event={"ID":"2f19b233-0051-4ec8-b8de-2193630937e6","Type":"ContainerStarted","Data":"deaeaa0db0146ea3260bc5e6884852b54ad276e3e5b85ac71ebb8d9635565ab2"} Jul 13 22:50:52.451089 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:52.451044 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:53.353483 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:53.353456 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8rtz_c1ee5b6f-56b2-4956-a8de-8634b7830187/dns/0.log" Jul 13 22:50:53.372061 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:53.372040 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8rtz_c1ee5b6f-56b2-4956-a8de-8634b7830187/kube-rbac-proxy/0.log" Jul 13 22:50:53.480126 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:53.480100 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5tw9l_3d3dfbe4-1786-4e15-aa28-b0854769ddca/dns-node-resolver/0.log" Jul 13 22:50:54.101865 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:54.101824 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lnd6b_2afd7034-1a80-40a3-9ecb-fce5b0e9536a/node-ca/0.log" Jul 13 22:50:55.358722 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:55.358687 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67f58f88b6-nnmpp_010f49e0-93f7-49d9-b7ae-f0a740745eb1/kube-auth-proxy/0.log" Jul 13 22:50:55.588230 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:55.588199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5957f79d44-8gl4v_265ffc2b-2b91-406a-8533-4584e155db46/router/0.log" Jul 13 22:50:56.270488 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:56.270456 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6b55c_90e25d52-cfe3-40c1-8c4b-45d527aecf2a/serve-healthcheck-canary/0.log" Jul 13 22:50:56.768480 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:56.768446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jhjjc_0f04bca0-c73d-4ac2-971c-37b9596d5d53/insights-operator/0.log" Jul 13 22:50:56.770285 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:56.770261 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jhjjc_0f04bca0-c73d-4ac2-971c-37b9596d5d53/insights-operator/1.log" Jul 13 22:50:56.927994 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:56.927967 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqvxz_5610c01c-4319-45be-9c57-de3d60626fb6/kube-rbac-proxy/0.log" Jul 13 22:50:56.951202 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:56.951177 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqvxz_5610c01c-4319-45be-9c57-de3d60626fb6/exporter/0.log" Jul 13 22:50:56.971081 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:56.971053 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqvxz_5610c01c-4319-45be-9c57-de3d60626fb6/extractor/0.log" Jul 13 22:50:58.471347 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:58.471319 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" Jul 13 22:50:58.486969 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:58.486920 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g7vdh/perf-node-gather-daemonset-bg489" podStartSLOduration=7.486904133 podStartE2EDuration="7.486904133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:50:52.466930289 +0000 UTC m=+2257.070206517" watchObservedRunningTime="2026-07-13 22:50:58.486904133 +0000 UTC m=+2263.090180359" Jul 13 22:50:58.999026 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:58.998987 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zjss2_a592c933-bc86-4649-ba91-629c3be8fc49/manager/0.log" Jul 13 22:50:59.145498 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:59.145467 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x6zkd_ac18bcc6-bc98-4aa8-9d16-7b80c057a5c8/manager/0.log" Jul 13 22:50:59.301384 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:59.301355 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-w7tvz_accb3645-de69-4da9-8af3-367fd144dd36/server/0.log" Jul 13 22:50:59.375445 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:59.375392 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kw5q2_dde19b41-3b72-44a8-8d21-b2d560ba7071/manager/0.log" Jul 13 22:50:59.462302 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:59.462268 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5bf5468b-6b67g_dfb66788-ff43-438a-819e-ee9ae4088d4a/manager/0.log" Jul 13 22:50:59.481408 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:50:59.481376 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5bf5468b-6b67g_dfb66788-ff43-438a-819e-ee9ae4088d4a/copy-manifests/0.log" Jul 13 22:51:01.451614 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:01.451546 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67f58f88b6-nnmpp_010f49e0-93f7-49d9-b7ae-f0a740745eb1/kube-auth-proxy/0.log" Jul 13 22:51:01.646252 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:01.646155 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5957f79d44-8gl4v_265ffc2b-2b91-406a-8533-4584e155db46/router/0.log" Jul 13 22:51:02.291944 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:02.291901 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-grfc9_4f05950a-68e3-4846-af4d-99d2b0eb778d/konnectivity-agent/0.log" limit=1024 Jul 13 22:51:02.966168 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:02.966097 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67f58f88b6-nnmpp_010f49e0-93f7-49d9-b7ae-f0a740745eb1/kube-auth-proxy/0.log" Jul 13 22:51:03.164804 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:03.164730 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5957f79d44-8gl4v_265ffc2b-2b91-406a-8533-4584e155db46/router/0.log" Jul 13 22:51:06.397019 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:06.396986 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-sn86f_0c98ef70-1761-4133-be89-3f213b9af5d6/kube-storage-version-migrator-operator/1.log" Jul 13 22:51:06.397885 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:06.397845 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-sn86f_0c98ef70-1761-4133-be89-3f213b9af5d6/kube-storage-version-migrator-operator/0.log" Jul 13 22:51:07.589892 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:07.589863 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kgmrv_a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5/kube-multus-additional-cni-plugins/0.log" Jul 13 22:51:07.612297 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:07.612270 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kgmrv_a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5/egress-router-binary-copy/0.log" Jul 13 22:51:07.634054 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:07.634030 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kgmrv_a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5/cni-plugins/0.log" Jul 13 22:51:07.658109 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:07.658088 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kgmrv_a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5/bond-cni-plugin/0.log" Jul 13 22:51:07.677652 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:07.677633 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kgmrv_a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5/routeoverride-cni/0.log" Jul 13 22:51:07.698699 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:07.698682 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kgmrv_a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5/whereabouts-cni-bincopy/0.log" Jul 13 22:51:07.722078 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:07.722059 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kgmrv_a2a344b5-ba10-4a7e-8a5a-e64e5d2ad5a5/whereabouts-cni/0.log" Jul 13 22:51:07.921172 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:07.921088 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k9b8w_5491dbeb-ab6d-4214-80b9-8b1712fe7227/kube-multus/0.log" Jul 13 22:51:07.984244 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:07.984214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8fp6d_52ce273b-88d0-4597-9a08-4e59ccf7820d/network-metrics-daemon/0.log" Jul 13 22:51:08.000172 ip-10-0-137-241 kubenswrapper[2581]: I0713 22:51:08.000147 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8fp6d_52ce273b-88d0-4597-9a08-4e59ccf7820d/kube-rbac-proxy/0.log"