Jun 05 21:15:57.950784 ip-10-0-136-234 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 21:15:57.950796 ip-10-0-136-234 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 21:15:57.950806 ip-10-0-136-234 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 21:15:57.951017 ip-10-0-136-234 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 21:16:08.023059 ip-10-0-136-234 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 21:16:08.023081 ip-10-0-136-234 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ab064997d3fa4192874d24cd128d1765 -- Jun 05 21:18:34.790788 ip-10-0-136-234 systemd[1]: Starting Kubernetes Kubelet... Jun 05 21:18:35.263602 ip-10-0-136-234 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:18:35.263602 ip-10-0-136-234 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 21:18:35.263602 ip-10-0-136-234 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:18:35.263602 ip-10-0-136-234 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 21:18:35.263602 ip-10-0-136-234 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 21:18:35.264947 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.264858 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 21:18:35.271010 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.270992 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:35.271010 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271010 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271014 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271017 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271022 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271025 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271028 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271031 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271034 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271036 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271039 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271042 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271045 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271048 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271050 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271053 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271056 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271058 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271061 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271063 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271066 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:35.271077 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271068 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271071 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271074 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271076 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271079 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271082 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271085 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271092 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271094 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271097 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271100 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271102 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271105 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271107 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271110 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271112 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271115 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271117 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271119 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271122 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:35.271572 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271126 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271128 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271131 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271133 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271136 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271140 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271145 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271148 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271150 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271153 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271156 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271159 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271161 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271164 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271167 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271170 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271172 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271175 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271178 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271181 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:35.272071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271183 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271186 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271188 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271191 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271193 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271195 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271198 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271201 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271205 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271208 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271212 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271214 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271217 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271220 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271223 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271225 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271228 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271231 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271235 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271239 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:35.272586 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271241 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271244 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271271 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271275 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271278 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271281 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271284 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271286 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271289 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271292 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271295 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271297 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271300 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271303 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271307 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271310 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271313 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.271316 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272053 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:35.273071 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272060 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272063 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272066 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272069 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272072 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272074 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272077 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272080 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272085 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272089 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272091 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272094 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272097 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272100 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272103 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272106 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272109 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272111 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272114 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:35.273565 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272117 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272120 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272123 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272125 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272128 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272130 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272133 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272136 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272139 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272142 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272146 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272150 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272153 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272155 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272158 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272161 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272163 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272166 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272168 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272171 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:35.274036 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272173 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272176 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272179 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272181 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272184 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272187 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272197 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272199 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272203 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272206 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272209 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272215 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272218 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272220 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272223 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272225 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272228 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272231 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272233 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272236 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:35.274544 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272238 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272241 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272243 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272246 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272248 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272251 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272253 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272257 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272259 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272262 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272264 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272267 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272270 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272272 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272274 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272277 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272281 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272283 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272286 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:35.275041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272289 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272293 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272297 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272300 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272319 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272323 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272345 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272348 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272352 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272355 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272357 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272360 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272363 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272366 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272368 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272371 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272374 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272377 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272379 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272382 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:35.275536 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272818 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272823 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272827 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272830 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272834 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272837 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272840 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272843 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272846 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272849 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272854 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272857 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272861 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272864 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272867 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272870 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272873 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272875 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272878 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:35.276138 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272881 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272885 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272889 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272892 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272895 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272898 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272901 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272903 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272906 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272908 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272911 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272914 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272916 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272919 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272921 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272924 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272927 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272929 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272932 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:35.276655 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272934 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272937 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272939 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272942 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272944 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272947 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272949 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272952 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272955 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272957 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272959 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272962 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272964 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272967 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272969 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272972 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272975 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272978 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272980 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272983 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272986 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:35.277122 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272989 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272991 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272994 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272997 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.272999 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273002 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273004 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273007 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273009 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273012 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273016 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273019 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273022 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273025 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273027 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273031 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273034 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273037 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273039 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:35.277658 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273043 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273045 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273048 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273050 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273053 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273056 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273058 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273060 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273063 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273066 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273068 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273071 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273073 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273079 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273081 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273084 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273086 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273089 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273092 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:35.278126 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273094 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273097 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273167 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273175 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273182 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273187 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273191 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273194 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273199 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273203 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273206 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273209 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273213 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273216 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273220 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273223 2567 flags.go:64] FLAG: --cgroup-root="" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273226 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273230 2567 flags.go:64] FLAG: --client-ca-file="" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273233 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273235 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273240 2567 flags.go:64] FLAG: --cluster-domain="" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273243 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273247 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273250 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 21:18:35.278604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273254 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273258 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273262 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273266 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273269 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273273 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273276 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273278 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273282 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273285 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273289 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273292 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273295 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273298 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273301 2567 flags.go:64] FLAG: --enable-server="true" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273303 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273308 2567 flags.go:64] FLAG: --event-burst="100" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273312 2567 flags.go:64] FLAG: --event-qps="50" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273315 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273318 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273321 2567 flags.go:64] FLAG: --eviction-hard="" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273339 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273343 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273346 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273350 2567 flags.go:64] FLAG: --eviction-soft="" Jun 05 21:18:35.279189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273353 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273355 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273358 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273361 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273364 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273372 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273375 2567 flags.go:64] FLAG: --feature-gates="" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273379 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273382 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273386 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273390 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273393 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273396 2567 flags.go:64] FLAG: --help="false" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273399 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273402 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273405 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273408 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273411 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273414 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273417 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273420 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273423 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273426 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 21:18:35.279816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273429 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273432 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273435 2567 flags.go:64] FLAG: --kube-reserved="" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273438 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273440 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273444 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273446 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273449 2567 flags.go:64] FLAG: --lock-file="" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273453 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273455 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273458 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273464 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273467 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273470 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273474 2567 flags.go:64] FLAG: --logging-format="text" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273477 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273480 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273483 2567 flags.go:64] FLAG: --manifest-url="" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273488 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273492 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273496 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273500 2567 flags.go:64] FLAG: --max-pods="110" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273503 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273506 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273509 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 21:18:35.280611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273512 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273515 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273518 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273521 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273528 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273531 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273534 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273537 2567 flags.go:64] FLAG: --pod-cidr="" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273540 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273545 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273548 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273551 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273554 2567 flags.go:64] FLAG: --port="10250" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273557 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273560 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-084792e6f66f40bd7" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273563 2567 flags.go:64] FLAG: --qos-reserved="" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273567 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273570 2567 flags.go:64] FLAG: --register-node="true" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273573 2567 flags.go:64] FLAG: --register-with-taints="" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273577 2567 flags.go:64] FLAG: --registry-burst="10" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273580 2567 flags.go:64] FLAG: --registry-qps="5" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273585 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273588 2567 flags.go:64] FLAG: --reserved-memory="" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273591 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273595 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 21:18:35.281747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273598 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273601 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273604 2567 flags.go:64] FLAG: --runonce="false" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273607 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273610 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273613 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273615 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273618 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273621 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273624 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273628 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273631 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273634 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273636 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273639 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273642 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273645 2567 flags.go:64] FLAG: --system-cgroups="" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273648 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273653 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273655 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273658 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273662 2567 flags.go:64] FLAG: --tls-min-version="" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273665 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273668 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273671 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 21:18:35.282849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273674 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273677 2567 flags.go:64] FLAG: --v="2" Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273681 2567 flags.go:64] FLAG: --version="false" Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273687 2567 flags.go:64] FLAG: --vmodule="" Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273691 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.273694 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273828 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273833 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273836 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273840 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273845 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273848 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273852 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273854 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273857 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273861 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273865 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273867 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273870 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273873 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:35.284004 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273877 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273881 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273883 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273886 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273889 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273892 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273895 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273898 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273900 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273903 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273905 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273908 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273911 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273913 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273916 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273920 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273923 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273925 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273928 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273930 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:35.284596 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273933 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273935 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273938 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273941 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273943 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273945 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273948 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273950 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273953 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273955 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273958 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273960 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273963 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273966 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273968 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273971 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273973 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273976 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273979 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273981 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:35.285428 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273983 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273986 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273988 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273991 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273993 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273996 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.273999 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274002 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274005 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274008 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274010 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274013 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274016 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274018 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274021 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274023 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274026 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274028 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274031 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274034 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:35.286232 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274036 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274039 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274042 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274045 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274047 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274050 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274052 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274055 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274057 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274059 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274062 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274065 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274067 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274070 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274072 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274075 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274077 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274080 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274083 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:35.287059 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274087 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274091 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274093 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274096 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274098 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.274101 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.274862 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.282558 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.282578 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.282607 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.282616 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282703 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282711 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282716 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282721 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:35.287619 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282726 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282731 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282736 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282741 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282746 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282750 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282754 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282758 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282762 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282767 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282771 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282775 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282779 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282784 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282788 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282793 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282797 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282801 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282805 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282812 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:35.288031 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282818 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282823 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282828 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282832 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282837 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282843 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282847 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282852 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282856 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282860 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282864 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282868 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282872 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282876 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282881 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282885 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282889 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282894 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282898 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282903 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:35.288614 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282908 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282912 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282916 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282921 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282925 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282929 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282933 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282937 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282944 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282950 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282955 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282960 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282965 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282970 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282975 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282980 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282986 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282991 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.282996 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:35.289108 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283001 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283005 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283009 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283013 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283018 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283022 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283027 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283031 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283036 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283040 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283044 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283048 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283052 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283057 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283061 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283065 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283069 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283074 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283078 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283082 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:35.289671 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283086 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283092 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283097 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283102 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283106 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283110 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283114 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283118 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283123 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283127 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283132 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283137 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283142 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283147 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283151 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:35.290183 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283155 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.283164 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283367 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283378 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283384 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283389 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283394 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283399 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283404 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283408 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283413 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283417 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283422 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283427 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283432 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 21:18:35.290595 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283436 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283440 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283445 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283449 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283455 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283462 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283467 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283472 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283476 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283481 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283485 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283489 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283494 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283499 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283503 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283509 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283514 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283519 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283524 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 21:18:35.291109 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283528 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283532 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283536 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283541 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283545 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283549 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283553 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283557 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283562 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283566 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283570 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283575 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283579 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283582 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283587 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283591 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283596 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283600 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283604 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283608 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 21:18:35.291610 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283612 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283616 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283620 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283624 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283628 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283633 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283638 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283642 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283646 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283651 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283656 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283659 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283675 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283680 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283684 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283688 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283692 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283697 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283701 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 21:18:35.292140 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283705 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283709 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283713 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283719 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283724 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283729 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283734 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283738 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283742 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283747 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283751 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283755 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283759 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283764 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283768 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283772 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283776 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283780 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283785 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283789 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 21:18:35.292694 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283794 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283801 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283806 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283811 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283816 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283821 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283825 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:35.283830 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.283838 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.284019 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.286897 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.288475 2567 server.go:1019] "Starting client certificate rotation" Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.288584 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 21:18:35.293189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.288620 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 21:18:35.293537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.292757 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 21:18:35.296438 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.296414 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 21:18:35.307159 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.307138 2567 log.go:25] "Validated CRI v1 runtime API" Jun 05 21:18:35.310675 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.310655 2567 log.go:25] "Validated CRI v1 image API" Jun 05 21:18:35.312375 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.312360 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 21:18:35.314916 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.314879 2567 fs.go:135] Filesystem UUIDs: map[15fd95de-287a-41ec-94b5-03fe9ab54528:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fed57cde-6209-4069-a829-b9c9908f5cd5:/dev/nvme0n1p4] Jun 05 21:18:35.315010 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.314909 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 21:18:35.319567 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.319550 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 21:18:35.320942 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.320833 2567 manager.go:216] Machine: {Timestamp:2026-06-05 21:18:35.319407203 +0000 UTC m=+0.387817092 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094458 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d88f66a3c4afec28de2aed838303a SystemUUID:ec2d88f6-6a3c-4afe-c28d-e2aed838303a BootID:ab064997-d3fa-4192-874d-24cd128d1765 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b9:2b:31:88:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b9:2b:31:88:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:df:ab:82:eb:d2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 21:18:35.320942 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.320937 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 21:18:35.321074 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.321062 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 21:18:35.324875 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.324842 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 21:18:35.325112 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.324887 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 21:18:35.326037 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.325824 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 21:18:35.326037 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.325842 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 21:18:35.326037 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.325854 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 21:18:35.326037 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.325874 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 21:18:35.327247 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.327233 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 21:18:35.331706 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.331693 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 05 21:18:35.331815 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.331806 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 21:18:35.331847 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.331836 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 05 21:18:35.331847 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.331846 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 21:18:35.331905 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.331863 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 21:18:35.331905 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.331874 2567 kubelet.go:398] "Adding apiserver pod source" Jun 05 21:18:35.331905 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.331883 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 21:18:35.332216 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.332205 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 21:18:35.332260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.332222 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 21:18:35.334599 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.334583 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 21:18:35.336379 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.336363 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 21:18:35.336469 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.336401 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 21:18:35.337918 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.337903 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 21:18:35.337988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.337925 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 21:18:35.337988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.337934 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 21:18:35.337988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.337942 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 21:18:35.337988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.337955 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 21:18:35.337988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.337963 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 21:18:35.337988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.337974 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 21:18:35.337988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.337983 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 21:18:35.338233 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.338002 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 21:18:35.338233 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.338011 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 21:18:35.338233 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.338029 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 21:18:35.338233 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.338039 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 21:18:35.339894 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.339881 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 21:18:35.339950 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.339897 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 21:18:35.343246 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.343221 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 21:18:35.343357 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.343257 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 21:18:35.343412 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.343355 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 21:18:35.343412 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.343374 2567 server.go:1268] "Started kubelet" Jun 05 21:18:35.343492 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.343410 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 21:18:35.343841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.343653 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 21:18:35.348074 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.348033 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 21:18:35.348584 ip-10-0-136-234 systemd[1]: Started Kubernetes Kubelet. Jun 05 21:18:35.350370 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.350305 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 21:18:35.350517 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.350499 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 05 21:18:35.352554 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.352535 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 21:18:35.354686 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.353573 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-234.ec2.internal.18b64c0b9798a04a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-234.ec2.internal,UID:ip-10-0-136-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-234.ec2.internal,},FirstTimestamp:2026-06-05 21:18:35.34332321 +0000 UTC m=+0.411733144,LastTimestamp:2026-06-05 21:18:35.34332321 +0000 UTC m=+0.411733144,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-234.ec2.internal,}" Jun 05 21:18:35.357599 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.357585 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 21:18:35.357676 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.357596 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 21:18:35.357732 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.357679 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:35.358532 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.358514 2567 factory.go:55] Registering systemd factory Jun 05 21:18:35.358618 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.358553 2567 factory.go:223] Registration of the systemd container factory successfully Jun 05 21:18:35.358849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.358830 2567 factory.go:153] Registering CRI-O factory Jun 05 21:18:35.358939 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.358864 2567 factory.go:223] Registration of the crio container factory successfully Jun 05 21:18:35.358939 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.358918 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 21:18:35.359055 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.358939 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 21:18:35.359055 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.358957 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 21:18:35.359055 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.358944 2567 factory.go:103] Registering Raw factory Jun 05 21:18:35.359055 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.359004 2567 manager.go:1196] Started watching for new ooms in manager Jun 05 21:18:35.359189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.359148 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 05 21:18:35.359189 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.359158 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 05 21:18:35.359477 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.359465 2567 manager.go:349] Starting recovery of all containers Jun 05 21:18:35.359837 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.359814 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 21:18:35.366018 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.365990 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 21:18:35.366599 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.366125 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 21:18:35.366599 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.366283 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 21:18:35.369454 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.369438 2567 manager.go:354] Recovery completed Jun 05 21:18:35.369770 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.369747 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v4lbq" Jun 05 21:18:35.374110 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.374095 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:35.378240 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.378223 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v4lbq" Jun 05 21:18:35.378599 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.378585 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:35.378660 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.378614 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:35.378660 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.378625 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:35.379178 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.379166 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 21:18:35.379178 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.379177 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 21:18:35.379255 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.379192 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 05 21:18:35.379255 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.379230 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:35.380023 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.380008 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:35.380090 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.380034 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:35.380090 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.380044 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:35.381432 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.381408 2567 policy_none.go:49] "None policy: Start" Jun 05 21:18:35.381432 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.381429 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 21:18:35.381519 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.381443 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 21:18:35.381560 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.381479 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-234.ec2.internal.18b64c0b99b2e617 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-234.ec2.internal,UID:ip-10-0-136-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-234.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-234.ec2.internal,},FirstTimestamp:2026-06-05 21:18:35.378599447 +0000 UTC m=+0.447009340,LastTimestamp:2026-06-05 21:18:35.378599447 +0000 UTC m=+0.447009340,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-234.ec2.internal,}" Jun 05 21:18:35.383290 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.383274 2567 policy_none.go:47] "Start" Jun 05 21:18:35.424983 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.424964 2567 manager.go:337] "Starting Device Plugin manager" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.425002 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.425016 2567 server.go:87] "Starting device plugin registration server" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.425306 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.425321 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.425442 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.425524 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.425531 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.426002 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.426050 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.431426 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.431462 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.431480 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.431586 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 21:18:35.442612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.433317 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:35.525769 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.525698 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:35.526999 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.526973 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:35.527109 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.527018 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:35.527109 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.527031 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:35.527109 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.527056 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.531833 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.531811 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal"] Jun 05 21:18:35.531902 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.531877 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:35.533526 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.533508 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:35.533631 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.533537 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:35.533631 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.533548 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:35.535613 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.535598 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.535667 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.535620 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-234.ec2.internal\": node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:35.536103 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.536091 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:35.536212 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.536198 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.536261 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.536228 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:35.536897 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.536873 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:35.537001 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.536903 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:35.537001 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.536914 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:35.538775 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.538757 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:35.538864 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.538792 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:35.538864 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.538806 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:35.543220 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.543206 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.543277 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.543233 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 21:18:35.545287 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.545273 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientMemory" Jun 05 21:18:35.545366 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.545296 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 21:18:35.545366 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.545306 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeHasSufficientPID" Jun 05 21:18:35.554957 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.554936 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-234.ec2.internal\" not found" node="ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.561172 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.561153 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-234.ec2.internal\" not found" node="ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.563163 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.563149 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:35.660548 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.660514 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5e07cf7bd7f6864d075ef4f05d8ee12-config\") pod \"kube-apiserver-proxy-ip-10-0-136-234.ec2.internal\" (UID: \"a5e07cf7bd7f6864d075ef4f05d8ee12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.660636 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.660549 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18eb173a1015119f64d87edb90c8c9b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal\" (UID: \"18eb173a1015119f64d87edb90c8c9b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.660636 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.660572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18eb173a1015119f64d87edb90c8c9b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal\" (UID: \"18eb173a1015119f64d87edb90c8c9b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.663596 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.663575 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:35.761035 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.761008 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18eb173a1015119f64d87edb90c8c9b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal\" (UID: \"18eb173a1015119f64d87edb90c8c9b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.761113 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.761038 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18eb173a1015119f64d87edb90c8c9b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal\" (UID: \"18eb173a1015119f64d87edb90c8c9b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.761113 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.761056 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5e07cf7bd7f6864d075ef4f05d8ee12-config\") pod \"kube-apiserver-proxy-ip-10-0-136-234.ec2.internal\" (UID: \"a5e07cf7bd7f6864d075ef4f05d8ee12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.761177 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.761126 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/18eb173a1015119f64d87edb90c8c9b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal\" (UID: \"18eb173a1015119f64d87edb90c8c9b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.761209 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.761180 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5e07cf7bd7f6864d075ef4f05d8ee12-config\") pod \"kube-apiserver-proxy-ip-10-0-136-234.ec2.internal\" (UID: \"a5e07cf7bd7f6864d075ef4f05d8ee12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.761241 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.761216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18eb173a1015119f64d87edb90c8c9b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal\" (UID: \"18eb173a1015119f64d87edb90c8c9b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.764097 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.764078 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:35.861873 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.861800 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.864862 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.864842 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:35.867582 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:35.867565 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal" Jun 05 21:18:35.965608 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:35.965565 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:36.066211 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:36.066179 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:36.166872 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:36.166791 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:36.267468 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:36.267436 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:36.287640 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.287601 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 21:18:36.287798 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.287774 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 21:18:36.368547 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:36.368512 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:36.383504 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.383457 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 21:13:35 +0000 UTC" deadline="2028-01-16 01:54:05.662592757 +0000 UTC" Jun 05 21:18:36.383504 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.383492 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14140h35m29.279104868s" Jun 05 21:18:36.396836 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:36.396803 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18eb173a1015119f64d87edb90c8c9b1.slice/crio-e2b5b1a417f2af248e01879501f1e06fe1d8ccc2cc4d3a5f807142c1ad1581fc WatchSource:0}: Error finding container e2b5b1a417f2af248e01879501f1e06fe1d8ccc2cc4d3a5f807142c1ad1581fc: Status 404 returned error can't find the container with id e2b5b1a417f2af248e01879501f1e06fe1d8ccc2cc4d3a5f807142c1ad1581fc Jun 05 21:18:36.397060 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:36.397038 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e07cf7bd7f6864d075ef4f05d8ee12.slice/crio-622321f646dd3bd69b18c3ec9c8876f3e05c94bc28ce56d1b0d9290c39e79d5e WatchSource:0}: Error finding container 622321f646dd3bd69b18c3ec9c8876f3e05c94bc28ce56d1b0d9290c39e79d5e: Status 404 returned error can't find the container with id 622321f646dd3bd69b18c3ec9c8876f3e05c94bc28ce56d1b0d9290c39e79d5e Jun 05 21:18:36.404119 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.404097 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:18:36.434972 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.434835 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" event={"ID":"18eb173a1015119f64d87edb90c8c9b1","Type":"ContainerStarted","Data":"e2b5b1a417f2af248e01879501f1e06fe1d8ccc2cc4d3a5f807142c1ad1581fc"} Jun 05 21:18:36.435842 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.435818 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal" event={"ID":"a5e07cf7bd7f6864d075ef4f05d8ee12","Type":"ContainerStarted","Data":"622321f646dd3bd69b18c3ec9c8876f3e05c94bc28ce56d1b0d9290c39e79d5e"} Jun 05 21:18:36.469466 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:36.469435 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:36.507380 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.507357 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:36.569973 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:36.569933 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:36.670614 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:36.670572 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:36.760575 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.760491 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:36.771565 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:36.771541 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-234.ec2.internal\" not found" Jun 05 21:18:36.792206 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.792184 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:36.858535 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.858498 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" Jun 05 21:18:36.876178 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.876151 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 21:18:36.877454 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.877434 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal" Jun 05 21:18:36.886940 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:36.886908 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 21:18:37.334005 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.333966 2567 apiserver.go:52] "Watching apiserver" Jun 05 21:18:37.343473 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.343442 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 21:18:37.343839 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.343812 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-fxwsz","kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal","openshift-image-registry/node-ca-crm5k","openshift-multus/multus-bv8g6","openshift-multus/network-metrics-daemon-fpmnj","openshift-network-operator/iptables-alerter-rbskn","openshift-ovn-kubernetes/ovnkube-node-lwg78","kube-system/global-pull-secret-syncer-78t2z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc","openshift-cluster-node-tuning-operator/tuned-2lqnl","openshift-dns/node-resolver-hlhxh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal","openshift-multus/multus-additional-cni-plugins-vtt5b","openshift-network-diagnostics/network-check-target-xp69c"] Jun 05 21:18:37.346823 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.346765 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.348912 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.348890 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.349624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.349601 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 21:18:37.349624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.349626 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 21:18:37.349798 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.349630 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 21:18:37.349798 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.349649 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 21:18:37.350503 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.350483 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 21:18:37.350503 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.350496 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcc9c\"" Jun 05 21:18:37.350664 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.350488 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 21:18:37.351112 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.351096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.351198 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.351183 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 21:18:37.351872 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.351847 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 21:18:37.352134 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.352094 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 21:18:37.352134 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.352120 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 21:18:37.352463 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.352444 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8w85t\"" Jun 05 21:18:37.352463 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.352455 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 21:18:37.353277 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.353251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.355152 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.355119 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 21:18:37.355751 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.355732 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 21:18:37.355885 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.355867 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:37.355965 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.355943 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:37.356058 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.355959 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bm8mm\"" Jun 05 21:18:37.356058 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.356031 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 21:18:37.356238 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.356222 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-54vxd\"" Jun 05 21:18:37.356354 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.356316 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 21:18:37.358394 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.358377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.358812 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.358762 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 21:18:37.361014 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.360932 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.361014 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.361002 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:18:37.361170 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.361057 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 21:18:37.361170 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.361071 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 21:18:37.361271 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.361201 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dhxf9\"" Jun 05 21:18:37.363300 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.363245 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 21:18:37.363500 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.363484 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hszb9\"" Jun 05 21:18:37.363765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.363694 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:37.364030 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.364009 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 21:18:37.364117 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.364098 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 21:18:37.366435 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.366412 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:37.366534 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.366495 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:37.368280 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.368196 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 21:18:37.368532 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.368514 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.369678 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ww6wc\"" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.371843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-run-netns\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.371888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ztqg\" (UniqueName: \"kubernetes.io/projected/76714011-f2b4-489e-b19a-5aac794b91a7-kube-api-access-9ztqg\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.371923 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-cnibin\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.371954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-os-release\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.371982 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6wdj\" (UniqueName: \"kubernetes.io/projected/d3dee655-6d78-4584-a7b4-dc8b54feeca8-kube-api-access-g6wdj\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-etc-openvswitch\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-cni-netd\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372094 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09ef593f-65c0-474d-860a-99ba154e842d-ovnkube-config\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372126 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09ef593f-65c0-474d-860a-99ba154e842d-ovnkube-script-lib\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxrct\" (UniqueName: \"kubernetes.io/projected/09ef593f-65c0-474d-860a-99ba154e842d-kube-api-access-bxrct\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-etc-selinux\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372230 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-run-netns\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e0ece63-babe-4f8b-a960-33ea46fe7da7-serviceca\") pod \"node-ca-crm5k\" (UID: \"5e0ece63-babe-4f8b-a960-33ea46fe7da7\") " pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-cnibin\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372338 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-socket-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.372880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09ef593f-65c0-474d-860a-99ba154e842d-ovn-node-metrics-cert\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372434 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-var-lib-cni-bin\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3dee655-6d78-4584-a7b4-dc8b54feeca8-cni-binary-copy\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372519 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2d18026-5f50-4cbc-ada6-4da9f854c723-iptables-alerter-script\") pod \"iptables-alerter-rbskn\" (UID: \"c2d18026-5f50-4cbc-ada6-4da9f854c723\") " pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372568 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-systemd-units\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372605 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-run-ovn\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372641 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-registration-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-sys-fs\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3dee655-6d78-4584-a7b4-dc8b54feeca8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-cni-bin\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-var-lib-kubelet\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.372856 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-system-cni-dir\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.373843 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.373389 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.374526 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374059 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-multus-cni-dir\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.374526 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-system-cni-dir\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.374526 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.374526 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76714011-f2b4-489e-b19a-5aac794b91a7-cni-binary-copy\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.374526 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-hostroot\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.374751 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3dee655-6d78-4584-a7b4-dc8b54feeca8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.374751 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-run-multus-certs\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.374751 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-device-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.374751 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374707 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:37.374751 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374732 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-node-log\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.374968 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09ef593f-65c0-474d-860a-99ba154e842d-env-overrides\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.374968 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/76714011-f2b4-489e-b19a-5aac794b91a7-multus-daemon-config\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.375064 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.374983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2mrr\" (UniqueName: \"kubernetes.io/projected/5e0ece63-babe-4f8b-a960-33ea46fe7da7-kube-api-access-j2mrr\") pod \"node-ca-crm5k\" (UID: \"5e0ece63-babe-4f8b-a960-33ea46fe7da7\") " pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.375112 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.375062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-var-lib-openvswitch\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.375160 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.375107 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e0ece63-babe-4f8b-a960-33ea46fe7da7-host\") pod \"node-ca-crm5k\" (UID: \"5e0ece63-babe-4f8b-a960-33ea46fe7da7\") " pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.375206 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.375142 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-var-lib-cni-multus\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.375206 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.375186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-kubelet\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.375268 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.375231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-slash\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.375268 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.375255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-run-openvswitch\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.375379 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.375285 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-os-release\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.375379 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.375315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-multus-socket-dir-parent\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.375887 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.375865 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-etc-kubernetes\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.376047 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-run-systemd\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.376182 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-log-socket\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.376357 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhfh4\" (UniqueName: \"kubernetes.io/projected/031bd02f-d377-4184-bc0f-036faceb352f-kube-api-access-xhfh4\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.376357 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrchg\" (UniqueName: \"kubernetes.io/projected/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-kube-api-access-qrchg\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:37.376357 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376237 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2d18026-5f50-4cbc-ada6-4da9f854c723-host-slash\") pod \"iptables-alerter-rbskn\" (UID: \"c2d18026-5f50-4cbc-ada6-4da9f854c723\") " pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.376357 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gb5w\" (UniqueName: \"kubernetes.io/projected/c2d18026-5f50-4cbc-ada6-4da9f854c723-kube-api-access-5gb5w\") pod \"iptables-alerter-rbskn\" (UID: \"c2d18026-5f50-4cbc-ada6-4da9f854c723\") " pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.376357 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.376702 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-run-k8s-cni-cncf-io\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.376702 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-multus-conf-dir\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.376702 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376421 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.376702 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.376691 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.377311 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.377290 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4q2ms\"" Jun 05 21:18:37.377426 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.377295 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:18:37.377616 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.377591 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 21:18:37.379512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.379255 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 21:18:37.379512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.379405 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:37.379512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.379260 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 21:18:37.379512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.379433 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cz77x\"" Jun 05 21:18:37.379512 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.379474 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:37.381205 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.381065 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 21:18:37.418845 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.418820 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpvf9" Jun 05 21:18:37.428187 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.428157 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpvf9" Jun 05 21:18:37.461004 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.460978 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 21:18:37.476769 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.476740 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.476769 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.476773 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76714011-f2b4-489e-b19a-5aac794b91a7-cni-binary-copy\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.477009 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.476792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-hostroot\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.477009 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.476844 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3dee655-6d78-4584-a7b4-dc8b54feeca8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.477009 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.476866 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.477009 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.476879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-systemd\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.477009 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.476873 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-hostroot\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.477009 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.476935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2s29\" (UniqueName: \"kubernetes.io/projected/9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c-kube-api-access-p2s29\") pod \"node-resolver-hlhxh\" (UID: \"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c\") " pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.477009 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.476985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-run-multus-certs\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.477009 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-device-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477034 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-modprobe-d\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477113 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-node-log\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477127 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-device-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09ef593f-65c0-474d-860a-99ba154e842d-env-overrides\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477172 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-run-multus-certs\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477182 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/76714011-f2b4-489e-b19a-5aac794b91a7-multus-daemon-config\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-node-log\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e7afb40-b6cd-4736-bfe7-abc5e2628b7e-konnectivity-ca\") pod \"konnectivity-agent-fxwsz\" (UID: \"3e7afb40-b6cd-4736-bfe7-abc5e2628b7e\") " pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-sysconfig\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.477371 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477428 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-sysctl-d\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.477479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477479 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a2ad12e-90b3-4799-b832-5b84236be445-tmp\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2mrr\" (UniqueName: \"kubernetes.io/projected/5e0ece63-babe-4f8b-a960-33ea46fe7da7-kube-api-access-j2mrr\") pod \"node-ca-crm5k\" (UID: \"5e0ece63-babe-4f8b-a960-33ea46fe7da7\") " pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477633 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-run\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477680 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-var-lib-openvswitch\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477706 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09ef593f-65c0-474d-860a-99ba154e842d-env-overrides\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76714011-f2b4-489e-b19a-5aac794b91a7-cni-binary-copy\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-var-lib-openvswitch\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.477757 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs podName:aa53bf6c-8b56-457a-9ccd-ccd794dc48a8 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:37.977692668 +0000 UTC m=+3.046102562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs") pod "network-metrics-daemon-fpmnj" (UID: "aa53bf6c-8b56-457a-9ccd-ccd794dc48a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3dee655-6d78-4584-a7b4-dc8b54feeca8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477886 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e0ece63-babe-4f8b-a960-33ea46fe7da7-host\") pod \"node-ca-crm5k\" (UID: \"5e0ece63-babe-4f8b-a960-33ea46fe7da7\") " pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477923 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-var-lib-cni-multus\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477962 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e0ece63-babe-4f8b-a960-33ea46fe7da7-host\") pod \"node-ca-crm5k\" (UID: \"5e0ece63-babe-4f8b-a960-33ea46fe7da7\") " pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-kubelet\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.477983 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-var-lib-cni-multus\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478015 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/76714011-f2b4-489e-b19a-5aac794b91a7-multus-daemon-config\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-slash\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478079 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-slash\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478122 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-run-openvswitch\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478130 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-kubelet\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-os-release\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478174 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-run-openvswitch\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-multus-socket-dir-parent\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-etc-kubernetes\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478231 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-os-release\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478231 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-multus-socket-dir-parent\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478264 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-etc-kubernetes\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478275 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-run-systemd\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-log-socket\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhfh4\" (UniqueName: \"kubernetes.io/projected/031bd02f-d377-4184-bc0f-036faceb352f-kube-api-access-xhfh4\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478343 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrchg\" (UniqueName: \"kubernetes.io/projected/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-kube-api-access-qrchg\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478358 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-log-socket\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478364 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2d18026-5f50-4cbc-ada6-4da9f854c723-host-slash\") pod \"iptables-alerter-rbskn\" (UID: \"c2d18026-5f50-4cbc-ada6-4da9f854c723\") " pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-run-systemd\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.478840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478399 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2d18026-5f50-4cbc-ada6-4da9f854c723-host-slash\") pod \"iptables-alerter-rbskn\" (UID: \"c2d18026-5f50-4cbc-ada6-4da9f854c723\") " pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478424 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gb5w\" (UniqueName: \"kubernetes.io/projected/c2d18026-5f50-4cbc-ada6-4da9f854c723-kube-api-access-5gb5w\") pod \"iptables-alerter-rbskn\" (UID: \"c2d18026-5f50-4cbc-ada6-4da9f854c723\") " pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-kubernetes\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478493 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478511 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-sysctl-conf\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-host\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478559 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-run-k8s-cni-cncf-io\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-multus-conf-dir\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478670 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-multus-conf-dir\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478756 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-lib-modules\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478795 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-run-netns\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478843 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-run-k8s-cni-cncf-io\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ztqg\" (UniqueName: \"kubernetes.io/projected/76714011-f2b4-489e-b19a-5aac794b91a7-kube-api-access-9ztqg\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-run-netns\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-cnibin\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.479591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-os-release\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478944 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.478980 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-cnibin\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479044 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6wdj\" (UniqueName: \"kubernetes.io/projected/d3dee655-6d78-4584-a7b4-dc8b54feeca8-kube-api-access-g6wdj\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479070 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-os-release\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-etc-openvswitch\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-cni-netd\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09ef593f-65c0-474d-860a-99ba154e842d-ovnkube-config\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09ef593f-65c0-474d-860a-99ba154e842d-ovnkube-script-lib\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479266 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-etc-openvswitch\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479295 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxrct\" (UniqueName: \"kubernetes.io/projected/09ef593f-65c0-474d-860a-99ba154e842d-kube-api-access-bxrct\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479305 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-cni-netd\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479320 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-etc-selinux\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479445 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccp7t\" (UniqueName: \"kubernetes.io/projected/7a2ad12e-90b3-4799-b832-5b84236be445-kube-api-access-ccp7t\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479506 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-run-netns\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e0ece63-babe-4f8b-a960-33ea46fe7da7-serviceca\") pod \"node-ca-crm5k\" (UID: \"5e0ece63-babe-4f8b-a960-33ea46fe7da7\") " pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479582 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-cnibin\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.480369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479608 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-socket-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479634 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c-hosts-file\") pod \"node-resolver-hlhxh\" (UID: \"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c\") " pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-etc-selinux\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c-tmp-dir\") pod \"node-resolver-hlhxh\" (UID: \"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c\") " pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479775 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-cnibin\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e78fba84-c3e9-4148-992b-5db59929d675-dbus\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479835 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09ef593f-65c0-474d-860a-99ba154e842d-ovnkube-script-lib\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-run-netns\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-socket-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479931 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09ef593f-65c0-474d-860a-99ba154e842d-ovn-node-metrics-cert\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.479976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-var-lib-cni-bin\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480021 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3dee655-6d78-4584-a7b4-dc8b54feeca8-cni-binary-copy\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480060 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2d18026-5f50-4cbc-ada6-4da9f854c723-iptables-alerter-script\") pod \"iptables-alerter-rbskn\" (UID: \"c2d18026-5f50-4cbc-ada6-4da9f854c723\") " pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480175 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-var-lib-cni-bin\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480194 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e7afb40-b6cd-4736-bfe7-abc5e2628b7e-agent-certs\") pod \"konnectivity-agent-fxwsz\" (UID: \"3e7afb40-b6cd-4736-bfe7-abc5e2628b7e\") " pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480238 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480271 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-var-lib-kubelet\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.481158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480270 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09ef593f-65c0-474d-860a-99ba154e842d-ovnkube-config\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480345 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e78fba84-c3e9-4148-992b-5db59929d675-kubelet-config\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480363 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e0ece63-babe-4f8b-a960-33ea46fe7da7-serviceca\") pod \"node-ca-crm5k\" (UID: \"5e0ece63-babe-4f8b-a960-33ea46fe7da7\") " pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480394 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-systemd-units\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480387 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-run-ovn\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480456 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-systemd-units\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480479 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-registration-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480488 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-run-ovn\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-sys-fs\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-registration-dir\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3dee655-6d78-4584-a7b4-dc8b54feeca8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a2ad12e-90b3-4799-b832-5b84236be445-etc-tuned\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480592 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/031bd02f-d377-4184-bc0f-036faceb352f-sys-fs\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-cni-bin\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.481973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480653 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-var-lib-kubelet\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480658 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3dee655-6d78-4584-a7b4-dc8b54feeca8-cni-binary-copy\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480674 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-sys\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480713 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-system-cni-dir\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480720 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09ef593f-65c0-474d-860a-99ba154e842d-host-cni-bin\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480706 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2d18026-5f50-4cbc-ada6-4da9f854c723-iptables-alerter-script\") pod \"iptables-alerter-rbskn\" (UID: \"c2d18026-5f50-4cbc-ada6-4da9f854c723\") " pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-multus-cni-dir\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-host-var-lib-kubelet\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480758 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-system-cni-dir\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-system-cni-dir\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480816 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76714011-f2b4-489e-b19a-5aac794b91a7-multus-cni-dir\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.480865 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3dee655-6d78-4584-a7b4-dc8b54feeca8-system-cni-dir\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.482765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.481009 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3dee655-6d78-4584-a7b4-dc8b54feeca8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.484368 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.484345 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09ef593f-65c0-474d-860a-99ba154e842d-ovn-node-metrics-cert\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.506736 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.506701 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrchg\" (UniqueName: \"kubernetes.io/projected/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-kube-api-access-qrchg\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:37.506890 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.506804 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhfh4\" (UniqueName: \"kubernetes.io/projected/031bd02f-d377-4184-bc0f-036faceb352f-kube-api-access-xhfh4\") pod \"aws-ebs-csi-driver-node-496rc\" (UID: \"031bd02f-d377-4184-bc0f-036faceb352f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.506890 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.506808 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2mrr\" (UniqueName: \"kubernetes.io/projected/5e0ece63-babe-4f8b-a960-33ea46fe7da7-kube-api-access-j2mrr\") pod \"node-ca-crm5k\" (UID: \"5e0ece63-babe-4f8b-a960-33ea46fe7da7\") " pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.507809 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.507787 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ztqg\" (UniqueName: \"kubernetes.io/projected/76714011-f2b4-489e-b19a-5aac794b91a7-kube-api-access-9ztqg\") pod \"multus-bv8g6\" (UID: \"76714011-f2b4-489e-b19a-5aac794b91a7\") " pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.508772 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.508742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6wdj\" (UniqueName: \"kubernetes.io/projected/d3dee655-6d78-4584-a7b4-dc8b54feeca8-kube-api-access-g6wdj\") pod \"multus-additional-cni-plugins-vtt5b\" (UID: \"d3dee655-6d78-4584-a7b4-dc8b54feeca8\") " pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.510490 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.510466 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxrct\" (UniqueName: \"kubernetes.io/projected/09ef593f-65c0-474d-860a-99ba154e842d-kube-api-access-bxrct\") pod \"ovnkube-node-lwg78\" (UID: \"09ef593f-65c0-474d-860a-99ba154e842d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.512564 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.512541 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gb5w\" (UniqueName: \"kubernetes.io/projected/c2d18026-5f50-4cbc-ada6-4da9f854c723-kube-api-access-5gb5w\") pod \"iptables-alerter-rbskn\" (UID: \"c2d18026-5f50-4cbc-ada6-4da9f854c723\") " pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.548660 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.548626 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 21:18:37.581370 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581316 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccp7t\" (UniqueName: \"kubernetes.io/projected/7a2ad12e-90b3-4799-b832-5b84236be445-kube-api-access-ccp7t\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.581551 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581390 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c-hosts-file\") pod \"node-resolver-hlhxh\" (UID: \"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c\") " pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.581551 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581420 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c-tmp-dir\") pod \"node-resolver-hlhxh\" (UID: \"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c\") " pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.581551 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e78fba84-c3e9-4148-992b-5db59929d675-dbus\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:37.581551 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581525 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e78fba84-c3e9-4148-992b-5db59929d675-dbus\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:37.581551 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581525 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c-hosts-file\") pod \"node-resolver-hlhxh\" (UID: \"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c\") " pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.581807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e7afb40-b6cd-4736-bfe7-abc5e2628b7e-agent-certs\") pod \"konnectivity-agent-fxwsz\" (UID: \"3e7afb40-b6cd-4736-bfe7-abc5e2628b7e\") " pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:37.581807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:37.581807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581724 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-var-lib-kubelet\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.581807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581758 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e78fba84-c3e9-4148-992b-5db59929d675-kubelet-config\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:37.581807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a2ad12e-90b3-4799-b832-5b84236be445-etc-tuned\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581814 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-sys\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-systemd\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581841 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c-tmp-dir\") pod \"node-resolver-hlhxh\" (UID: \"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c\") " pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581864 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2s29\" (UniqueName: \"kubernetes.io/projected/9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c-kube-api-access-p2s29\") pod \"node-resolver-hlhxh\" (UID: \"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c\") " pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e78fba84-c3e9-4148-992b-5db59929d675-kubelet-config\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-modprobe-d\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581935 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e7afb40-b6cd-4736-bfe7-abc5e2628b7e-konnectivity-ca\") pod \"konnectivity-agent-fxwsz\" (UID: \"3e7afb40-b6cd-4736-bfe7-abc5e2628b7e\") " pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-sys\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-sysconfig\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581945 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-systemd\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581947 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-var-lib-kubelet\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.581982 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-sysctl-d\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a2ad12e-90b3-4799-b832-5b84236be445-tmp\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582023 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-run\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582029 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-sysconfig\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582080 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-kubernetes\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-modprobe-d\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582102 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-sysctl-conf\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-host\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582145 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-sysctl-d\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-lib-modules\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582187 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-run\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582217 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-sysctl-conf\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.582228 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582255 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-host\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-etc-kubernetes\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.582285 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret podName:e78fba84-c3e9-4148-992b-5db59929d675 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:38.082266151 +0000 UTC m=+3.150676043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret") pod "global-pull-secret-syncer-78t2z" (UID: "e78fba84-c3e9-4148-992b-5db59929d675") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582362 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a2ad12e-90b3-4799-b832-5b84236be445-lib-modules\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.582780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.582544 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e7afb40-b6cd-4736-bfe7-abc5e2628b7e-konnectivity-ca\") pod \"konnectivity-agent-fxwsz\" (UID: \"3e7afb40-b6cd-4736-bfe7-abc5e2628b7e\") " pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:37.584671 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.584613 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a2ad12e-90b3-4799-b832-5b84236be445-etc-tuned\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.584772 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.584750 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e7afb40-b6cd-4736-bfe7-abc5e2628b7e-agent-certs\") pod \"konnectivity-agent-fxwsz\" (UID: \"3e7afb40-b6cd-4736-bfe7-abc5e2628b7e\") " pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:37.585144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.585114 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a2ad12e-90b3-4799-b832-5b84236be445-tmp\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.591144 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.591120 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:37.591144 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.591146 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:37.591416 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.591162 2567 projected.go:196] Error preparing data for projected volume kube-api-access-qhh8s for pod openshift-network-diagnostics/network-check-target-xp69c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:37.591416 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.591237 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s podName:b2aef670-d15f-41ca-a1d2-ea0781cda092 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:38.091217896 +0000 UTC m=+3.159627795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qhh8s" (UniqueName: "kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s") pod "network-check-target-xp69c" (UID: "b2aef670-d15f-41ca-a1d2-ea0781cda092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:37.593955 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.593930 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccp7t\" (UniqueName: \"kubernetes.io/projected/7a2ad12e-90b3-4799-b832-5b84236be445-kube-api-access-ccp7t\") pod \"tuned-2lqnl\" (UID: \"7a2ad12e-90b3-4799-b832-5b84236be445\") " pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.594041 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.593954 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2s29\" (UniqueName: \"kubernetes.io/projected/9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c-kube-api-access-p2s29\") pod \"node-resolver-hlhxh\" (UID: \"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c\") " pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.657970 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.657944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:18:37.667683 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.667657 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-crm5k" Jun 05 21:18:37.678440 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.678417 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" Jun 05 21:18:37.683227 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.683206 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bv8g6" Jun 05 21:18:37.691558 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.691525 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rbskn" Jun 05 21:18:37.699210 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.699185 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" Jun 05 21:18:37.705962 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.705940 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:37.710780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.710760 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" Jun 05 21:18:37.715403 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.715386 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hlhxh" Jun 05 21:18:37.985803 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:37.985711 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:37.985941 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.985865 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:37.985941 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:37.985932 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs podName:aa53bf6c-8b56-457a-9ccd-ccd794dc48a8 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:38.985917589 +0000 UTC m=+4.054327471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs") pod "network-metrics-daemon-fpmnj" (UID: "aa53bf6c-8b56-457a-9ccd-ccd794dc48a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:38.086963 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.086926 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:38.087134 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:38.087082 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:38.087175 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:38.087149 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret podName:e78fba84-c3e9-4148-992b-5db59929d675 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:39.087134005 +0000 UTC m=+4.155543882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret") pod "global-pull-secret-syncer-78t2z" (UID: "e78fba84-c3e9-4148-992b-5db59929d675") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:38.187314 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.187276 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:38.187506 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:38.187462 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:38.187506 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:38.187488 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:38.187506 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:38.187505 2567 projected.go:196] Error preparing data for projected volume kube-api-access-qhh8s for pod openshift-network-diagnostics/network-check-target-xp69c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:38.187664 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:38.187582 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s podName:b2aef670-d15f-41ca-a1d2-ea0781cda092 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:39.18755529 +0000 UTC m=+4.255965184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhh8s" (UniqueName: "kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s") pod "network-check-target-xp69c" (UID: "b2aef670-d15f-41ca-a1d2-ea0781cda092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:38.312634 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:38.312601 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b33faf7_cd54_4f7d_b8a7_dd0c6817fe1c.slice/crio-36344b86a1390236ea8ffdab36881cd693c7ac2cf3993daf70733866e73f2fd9 WatchSource:0}: Error finding container 36344b86a1390236ea8ffdab36881cd693c7ac2cf3993daf70733866e73f2fd9: Status 404 returned error can't find the container with id 36344b86a1390236ea8ffdab36881cd693c7ac2cf3993daf70733866e73f2fd9 Jun 05 21:18:38.313532 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:38.313511 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2ad12e_90b3_4799_b832_5b84236be445.slice/crio-1e5388ba1caea9d4379255a8612b4a36e38367a50fbdc5579324ee7e62a67f87 WatchSource:0}: Error finding container 1e5388ba1caea9d4379255a8612b4a36e38367a50fbdc5579324ee7e62a67f87: Status 404 returned error can't find the container with id 1e5388ba1caea9d4379255a8612b4a36e38367a50fbdc5579324ee7e62a67f87 Jun 05 21:18:38.314292 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:38.314267 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76714011_f2b4_489e_b19a_5aac794b91a7.slice/crio-d39b7a81b4a74eba74401a3e5a5c543e9f8a660ef933fbc38365a4d4936606da WatchSource:0}: Error finding container d39b7a81b4a74eba74401a3e5a5c543e9f8a660ef933fbc38365a4d4936606da: Status 404 returned error can't find the container with id d39b7a81b4a74eba74401a3e5a5c543e9f8a660ef933fbc38365a4d4936606da Jun 05 21:18:38.316143 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:38.315766 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031bd02f_d377_4184_bc0f_036faceb352f.slice/crio-221cbc389319f0eb1a9bd44a93991c3b244af5bf54e73a82d02fd4089e80e9e5 WatchSource:0}: Error finding container 221cbc389319f0eb1a9bd44a93991c3b244af5bf54e73a82d02fd4089e80e9e5: Status 404 returned error can't find the container with id 221cbc389319f0eb1a9bd44a93991c3b244af5bf54e73a82d02fd4089e80e9e5 Jun 05 21:18:38.317718 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:38.317696 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ef593f_65c0_474d_860a_99ba154e842d.slice/crio-7674f99076c71bf13d987879d4a806b9d8fa4ba896619d963e0523cd5a3e8d78 WatchSource:0}: Error finding container 7674f99076c71bf13d987879d4a806b9d8fa4ba896619d963e0523cd5a3e8d78: Status 404 returned error can't find the container with id 7674f99076c71bf13d987879d4a806b9d8fa4ba896619d963e0523cd5a3e8d78 Jun 05 21:18:38.340128 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:38.340102 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3dee655_6d78_4584_a7b4_dc8b54feeca8.slice/crio-b9003c9929cb2cc4d1a2811be101ac0627f8bbb52ce210b58ca0fc77c638ec06 WatchSource:0}: Error finding container b9003c9929cb2cc4d1a2811be101ac0627f8bbb52ce210b58ca0fc77c638ec06: Status 404 returned error can't find the container with id b9003c9929cb2cc4d1a2811be101ac0627f8bbb52ce210b58ca0fc77c638ec06 Jun 05 21:18:38.340526 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:38.340503 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e7afb40_b6cd_4736_bfe7_abc5e2628b7e.slice/crio-a4bcde26ead658d2191b7408fc3fa98a0b5d0d949fec38b7db128e0221d88749 WatchSource:0}: Error finding container a4bcde26ead658d2191b7408fc3fa98a0b5d0d949fec38b7db128e0221d88749: Status 404 returned error can't find the container with id a4bcde26ead658d2191b7408fc3fa98a0b5d0d949fec38b7db128e0221d88749 Jun 05 21:18:38.341547 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:38.341515 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d18026_5f50_4cbc_ada6_4da9f854c723.slice/crio-7d493a32c38224768e81959534001cbdfe4bbda51c6ae1d2c11c242701b4ba1e WatchSource:0}: Error finding container 7d493a32c38224768e81959534001cbdfe4bbda51c6ae1d2c11c242701b4ba1e: Status 404 returned error can't find the container with id 7d493a32c38224768e81959534001cbdfe4bbda51c6ae1d2c11c242701b4ba1e Jun 05 21:18:38.342786 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:18:38.342769 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0ece63_babe_4f8b_a960_33ea46fe7da7.slice/crio-80d8a3dba43b0f2c37702ff53bfa9c138dc7c1c3aa3e259b9fd64b76db1e4471 WatchSource:0}: Error finding container 80d8a3dba43b0f2c37702ff53bfa9c138dc7c1c3aa3e259b9fd64b76db1e4471: Status 404 returned error can't find the container with id 80d8a3dba43b0f2c37702ff53bfa9c138dc7c1c3aa3e259b9fd64b76db1e4471 Jun 05 21:18:38.431595 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.431515 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 21:13:37 +0000 UTC" deadline="2027-12-26 08:56:08.303277854 +0000 UTC" Jun 05 21:18:38.431595 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.431589 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13643h37m29.871694346s" Jun 05 21:18:38.441355 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.441305 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal" event={"ID":"a5e07cf7bd7f6864d075ef4f05d8ee12","Type":"ContainerStarted","Data":"3cc7273e4863b674ab6dcef3c463a1915b5bf1b73c61099102e79a777d473a1f"} Jun 05 21:18:38.442493 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.442448 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-crm5k" event={"ID":"5e0ece63-babe-4f8b-a960-33ea46fe7da7","Type":"ContainerStarted","Data":"80d8a3dba43b0f2c37702ff53bfa9c138dc7c1c3aa3e259b9fd64b76db1e4471"} Jun 05 21:18:38.443728 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.443703 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rbskn" event={"ID":"c2d18026-5f50-4cbc-ada6-4da9f854c723","Type":"ContainerStarted","Data":"7d493a32c38224768e81959534001cbdfe4bbda51c6ae1d2c11c242701b4ba1e"} Jun 05 21:18:38.444907 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.444876 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fxwsz" event={"ID":"3e7afb40-b6cd-4736-bfe7-abc5e2628b7e","Type":"ContainerStarted","Data":"a4bcde26ead658d2191b7408fc3fa98a0b5d0d949fec38b7db128e0221d88749"} Jun 05 21:18:38.445866 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.445843 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" event={"ID":"d3dee655-6d78-4584-a7b4-dc8b54feeca8","Type":"ContainerStarted","Data":"b9003c9929cb2cc4d1a2811be101ac0627f8bbb52ce210b58ca0fc77c638ec06"} Jun 05 21:18:38.446869 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.446852 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" event={"ID":"09ef593f-65c0-474d-860a-99ba154e842d","Type":"ContainerStarted","Data":"7674f99076c71bf13d987879d4a806b9d8fa4ba896619d963e0523cd5a3e8d78"} Jun 05 21:18:38.448668 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.448648 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" event={"ID":"7a2ad12e-90b3-4799-b832-5b84236be445","Type":"ContainerStarted","Data":"1e5388ba1caea9d4379255a8612b4a36e38367a50fbdc5579324ee7e62a67f87"} Jun 05 21:18:38.452567 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.452547 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" event={"ID":"031bd02f-d377-4184-bc0f-036faceb352f","Type":"ContainerStarted","Data":"221cbc389319f0eb1a9bd44a93991c3b244af5bf54e73a82d02fd4089e80e9e5"} Jun 05 21:18:38.453562 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.453544 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bv8g6" event={"ID":"76714011-f2b4-489e-b19a-5aac794b91a7","Type":"ContainerStarted","Data":"d39b7a81b4a74eba74401a3e5a5c543e9f8a660ef933fbc38365a4d4936606da"} Jun 05 21:18:38.454305 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.454283 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hlhxh" event={"ID":"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c","Type":"ContainerStarted","Data":"36344b86a1390236ea8ffdab36881cd693c7ac2cf3993daf70733866e73f2fd9"} Jun 05 21:18:38.455775 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.455737 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-234.ec2.internal" podStartSLOduration=2.455724685 podStartE2EDuration="2.455724685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:38.45549944 +0000 UTC m=+3.523909339" watchObservedRunningTime="2026-06-05 21:18:38.455724685 +0000 UTC m=+3.524134584" Jun 05 21:18:38.993177 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:38.993073 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:38.993375 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:38.993278 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:38.993375 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:38.993361 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs podName:aa53bf6c-8b56-457a-9ccd-ccd794dc48a8 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:40.993341656 +0000 UTC m=+6.061751548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs") pod "network-metrics-daemon-fpmnj" (UID: "aa53bf6c-8b56-457a-9ccd-ccd794dc48a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:39.093684 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:39.093583 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:39.093865 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:39.093771 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:39.093865 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:39.093863 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret podName:e78fba84-c3e9-4148-992b-5db59929d675 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:41.093842823 +0000 UTC m=+6.162252714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret") pod "global-pull-secret-syncer-78t2z" (UID: "e78fba84-c3e9-4148-992b-5db59929d675") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:39.195036 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:39.194918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:39.195205 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:39.195090 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:39.195205 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:39.195108 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:39.195205 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:39.195121 2567 projected.go:196] Error preparing data for projected volume kube-api-access-qhh8s for pod openshift-network-diagnostics/network-check-target-xp69c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:39.195205 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:39.195178 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s podName:b2aef670-d15f-41ca-a1d2-ea0781cda092 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:41.195160001 +0000 UTC m=+6.263569887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhh8s" (UniqueName: "kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s") pod "network-check-target-xp69c" (UID: "b2aef670-d15f-41ca-a1d2-ea0781cda092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:39.432358 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:39.432262 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 21:13:37 +0000 UTC" deadline="2028-03-15 02:21:46.624641894 +0000 UTC" Jun 05 21:18:39.432358 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:39.432303 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15557h3m7.192344283s" Jun 05 21:18:39.433472 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:39.433450 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:39.433631 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:39.433604 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:39.434111 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:39.433784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:39.434111 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:39.433899 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:39.434111 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:39.433975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:39.434111 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:39.434061 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:39.466971 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:39.466935 2567 generic.go:356] "Generic (PLEG): container finished" podID="18eb173a1015119f64d87edb90c8c9b1" containerID="95b59826ae8ec6d99fbb786b362a3da78a4a212ecf077c9b66a2566fba36c797" exitCode=0 Jun 05 21:18:39.467875 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:39.467844 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" event={"ID":"18eb173a1015119f64d87edb90c8c9b1","Type":"ContainerDied","Data":"95b59826ae8ec6d99fbb786b362a3da78a4a212ecf077c9b66a2566fba36c797"} Jun 05 21:18:40.500398 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:40.499666 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" event={"ID":"18eb173a1015119f64d87edb90c8c9b1","Type":"ContainerStarted","Data":"b86b830d8075f955cd72ed07016b50949d6c67d764d93d48111d3a8663415e58"} Jun 05 21:18:41.010285 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:41.010249 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:41.010473 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.010425 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:41.010530 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.010490 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs podName:aa53bf6c-8b56-457a-9ccd-ccd794dc48a8 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:45.010472108 +0000 UTC m=+10.078882005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs") pod "network-metrics-daemon-fpmnj" (UID: "aa53bf6c-8b56-457a-9ccd-ccd794dc48a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:41.110839 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:41.110800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:41.111047 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.111028 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:41.111114 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.111102 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret podName:e78fba84-c3e9-4148-992b-5db59929d675 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:45.111081954 +0000 UTC m=+10.179491849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret") pod "global-pull-secret-syncer-78t2z" (UID: "e78fba84-c3e9-4148-992b-5db59929d675") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:41.211421 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:41.211379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:41.211627 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.211607 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:41.211720 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.211635 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:41.211720 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.211649 2567 projected.go:196] Error preparing data for projected volume kube-api-access-qhh8s for pod openshift-network-diagnostics/network-check-target-xp69c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:41.211720 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.211708 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s podName:b2aef670-d15f-41ca-a1d2-ea0781cda092 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:45.211688722 +0000 UTC m=+10.280098604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhh8s" (UniqueName: "kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s") pod "network-check-target-xp69c" (UID: "b2aef670-d15f-41ca-a1d2-ea0781cda092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:41.433400 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:41.432510 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:41.433400 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:41.432510 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:41.433400 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.432663 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:41.433400 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.432793 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:41.433400 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:41.432848 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:41.433400 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:41.432937 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:43.432147 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:43.431941 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:43.432147 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:43.431975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:43.432147 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:43.431941 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:43.432147 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:43.432145 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:43.432789 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:43.432200 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:43.432789 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:43.432311 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:45.045012 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:45.044807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:45.045557 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.044959 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:45.045557 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.045151 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs podName:aa53bf6c-8b56-457a-9ccd-ccd794dc48a8 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:53.045130152 +0000 UTC m=+18.113540035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs") pod "network-metrics-daemon-fpmnj" (UID: "aa53bf6c-8b56-457a-9ccd-ccd794dc48a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:45.145490 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:45.145455 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:45.145672 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.145588 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:45.145729 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.145676 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret podName:e78fba84-c3e9-4148-992b-5db59929d675 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:53.145652382 +0000 UTC m=+18.214062282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret") pod "global-pull-secret-syncer-78t2z" (UID: "e78fba84-c3e9-4148-992b-5db59929d675") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:45.246280 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:45.246246 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:45.246479 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.246444 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:45.246479 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.246465 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:45.246479 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.246479 2567 projected.go:196] Error preparing data for projected volume kube-api-access-qhh8s for pod openshift-network-diagnostics/network-check-target-xp69c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:45.246612 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.246553 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s podName:b2aef670-d15f-41ca-a1d2-ea0781cda092 nodeName:}" failed. No retries permitted until 2026-06-05 21:18:53.246531042 +0000 UTC m=+18.314940943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhh8s" (UniqueName: "kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s") pod "network-check-target-xp69c" (UID: "b2aef670-d15f-41ca-a1d2-ea0781cda092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:45.431751 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:45.431677 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:45.431911 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.431802 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:45.433012 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:45.432977 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:45.433139 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.433063 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:45.433139 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:45.433105 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:45.433258 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:45.433233 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:47.432261 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:47.432190 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:47.432746 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:47.432349 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:47.432746 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:47.432195 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:47.432746 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:47.432406 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:47.432746 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:47.432474 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:47.432948 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:47.432881 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:49.432650 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:49.432316 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:49.432650 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:49.432370 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:49.432650 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:49.432316 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:49.432650 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:49.432460 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:49.432650 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:49.432539 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:49.432650 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:49.432610 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:51.432640 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:51.432598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:51.433140 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:51.432598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:51.433140 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:51.432751 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:51.433140 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:51.432598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:51.433140 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:51.432829 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:51.433140 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:51.432914 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:53.104868 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:53.104825 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:53.105290 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.104979 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:53.105290 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.105042 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs podName:aa53bf6c-8b56-457a-9ccd-ccd794dc48a8 nodeName:}" failed. No retries permitted until 2026-06-05 21:19:09.105023507 +0000 UTC m=+34.173433398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs") pod "network-metrics-daemon-fpmnj" (UID: "aa53bf6c-8b56-457a-9ccd-ccd794dc48a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:18:53.205533 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:53.205491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:53.205726 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.205656 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:53.205783 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.205728 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret podName:e78fba84-c3e9-4148-992b-5db59929d675 nodeName:}" failed. No retries permitted until 2026-06-05 21:19:09.205710786 +0000 UTC m=+34.274120677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret") pod "global-pull-secret-syncer-78t2z" (UID: "e78fba84-c3e9-4148-992b-5db59929d675") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:18:53.306879 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:53.306836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:53.307121 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.307103 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:18:53.307175 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.307128 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:18:53.307175 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.307137 2567 projected.go:196] Error preparing data for projected volume kube-api-access-qhh8s for pod openshift-network-diagnostics/network-check-target-xp69c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:53.307264 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.307190 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s podName:b2aef670-d15f-41ca-a1d2-ea0781cda092 nodeName:}" failed. No retries permitted until 2026-06-05 21:19:09.307176592 +0000 UTC m=+34.375586469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhh8s" (UniqueName: "kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s") pod "network-check-target-xp69c" (UID: "b2aef670-d15f-41ca-a1d2-ea0781cda092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:18:53.434945 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:53.434870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:53.435093 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:53.434870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:53.435093 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.434990 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:53.435093 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:53.434878 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:53.435250 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.435089 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:53.435250 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:53.435134 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:55.436534 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:55.436499 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:55.437120 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:55.436545 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:55.437120 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:55.436545 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:55.437120 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:55.436609 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:55.437120 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:55.436756 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:55.437120 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:55.436844 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:57.432157 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.431977 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:57.432746 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.431986 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:57.432746 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:57.432247 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:57.432746 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.431986 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:57.432746 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:57.432307 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:57.432746 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:57.432383 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:57.536631 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.536592 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bv8g6" event={"ID":"76714011-f2b4-489e-b19a-5aac794b91a7","Type":"ContainerStarted","Data":"23e5117585479b49fdb31aa17dd20efabef6a689114ae665630e5237f239efa2"} Jun 05 21:18:57.538045 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.538019 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hlhxh" event={"ID":"9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c","Type":"ContainerStarted","Data":"56ac5d4d1cb5740fbf98da6b54b13abc209934e8f78ab0217ba383a08351dbf0"} Jun 05 21:18:57.539447 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.539423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-crm5k" event={"ID":"5e0ece63-babe-4f8b-a960-33ea46fe7da7","Type":"ContainerStarted","Data":"258a51588853b1725b0e78c12bd7c28a77e990d2f100eaff56afe9821e82acc1"} Jun 05 21:18:57.540890 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.540866 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fxwsz" event={"ID":"3e7afb40-b6cd-4736-bfe7-abc5e2628b7e","Type":"ContainerStarted","Data":"62fc1a2595a151a7fe3ab002f137b7d6bd33449fae179f3158f7c0912b641479"} Jun 05 21:18:57.542446 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.542425 2567 generic.go:356] "Generic (PLEG): container finished" podID="d3dee655-6d78-4584-a7b4-dc8b54feeca8" containerID="6b51a5bcfc05ee1a1fb55c64f3addaeb975d0ce878d6d7687e9c2db9184589f2" exitCode=0 Jun 05 21:18:57.542523 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.542504 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" event={"ID":"d3dee655-6d78-4584-a7b4-dc8b54feeca8","Type":"ContainerDied","Data":"6b51a5bcfc05ee1a1fb55c64f3addaeb975d0ce878d6d7687e9c2db9184589f2"} Jun 05 21:18:57.546005 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.545984 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" event={"ID":"09ef593f-65c0-474d-860a-99ba154e842d","Type":"ContainerStarted","Data":"d02b8f62874736cafc9624983b87eeea5c678f4520af6d18a2e376afbd894f5b"} Jun 05 21:18:57.546089 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.546048 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" event={"ID":"09ef593f-65c0-474d-860a-99ba154e842d","Type":"ContainerStarted","Data":"93a7bc645eae00716c99af99e58736b2756fee71dac525ea7a51815e90c8b5c5"} Jun 05 21:18:57.546149 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.546089 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" event={"ID":"09ef593f-65c0-474d-860a-99ba154e842d","Type":"ContainerStarted","Data":"63cda062407b0c179b01476723b0b55df8c1d5f20ce2a068bf4ba2859a2238b0"} Jun 05 21:18:57.546149 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.546129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" event={"ID":"09ef593f-65c0-474d-860a-99ba154e842d","Type":"ContainerStarted","Data":"af03d403117cbefe268ab705ff2b9e56582b4fbac2e5cef0209f8a551160ce7c"} Jun 05 21:18:57.546236 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.546163 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" event={"ID":"09ef593f-65c0-474d-860a-99ba154e842d","Type":"ContainerStarted","Data":"b83c54873b783834947b93756d04e0381078da040e163c5e4f779a8d3a99a36b"} Jun 05 21:18:57.546236 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.546206 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" event={"ID":"09ef593f-65c0-474d-860a-99ba154e842d","Type":"ContainerStarted","Data":"4fddef53bb5533f2e65ac633d96a29f9eae5c5083ff60fbadedee0b8174875b0"} Jun 05 21:18:57.547498 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.547480 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" event={"ID":"7a2ad12e-90b3-4799-b832-5b84236be445","Type":"ContainerStarted","Data":"785fce9fbc1f5699c5bcf74086d6fb92ffd5ee3a9ce6d9636ae3f9bd3194d358"} Jun 05 21:18:57.548957 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.548939 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" event={"ID":"031bd02f-d377-4184-bc0f-036faceb352f","Type":"ContainerStarted","Data":"9b87bcb6995f1a27abc00daa747bca8c0e239c2e84bc82bb6d9ebaf8028d70ea"} Jun 05 21:18:57.568547 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.568505 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bv8g6" podStartSLOduration=3.941719334 podStartE2EDuration="22.568492953s" totalImagesPullingTime="18.626773619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:57.568446163 +0000 UTC m=+22.636856063" watchObservedRunningTime="2026-06-05 21:18:57.568492953 +0000 UTC m=+22.636902851" Jun 05 21:18:57.568938 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.568914 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-234.ec2.internal" podStartSLOduration=21.568908612 podStartE2EDuration="21.568908612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:40.517374428 +0000 UTC m=+5.585784327" watchObservedRunningTime="2026-06-05 21:18:57.568908612 +0000 UTC m=+22.637318511" Jun 05 21:18:57.590141 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.590095 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fxwsz" podStartSLOduration=8.732540235 podStartE2EDuration="22.590081393s" totalImagesPullingTime="13.857541158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:57.589841466 +0000 UTC m=+22.658251366" watchObservedRunningTime="2026-06-05 21:18:57.590081393 +0000 UTC m=+22.658491291" Jun 05 21:18:57.608864 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.608822 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2lqnl" podStartSLOduration=4.028360565 podStartE2EDuration="22.608809791s" totalImagesPullingTime="18.580449226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:57.608404751 +0000 UTC m=+22.676814649" watchObservedRunningTime="2026-06-05 21:18:57.608809791 +0000 UTC m=+22.677219690" Jun 05 21:18:57.622142 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:57.622093 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hlhxh" podStartSLOduration=4.040000776 podStartE2EDuration="22.622079305s" totalImagesPullingTime="18.582078529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:57.621626938 +0000 UTC m=+22.690036838" watchObservedRunningTime="2026-06-05 21:18:57.622079305 +0000 UTC m=+22.690489204" Jun 05 21:18:58.207478 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:58.207263 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 21:18:58.439519 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:58.439410 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T21:18:58.20747462Z","UUID":"31508207-badf-4d29-a910-247ec62175ec","Handler":null,"Name":"","Endpoint":""} Jun 05 21:18:58.440852 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:58.440786 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 21:18:58.440852 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:58.440826 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 21:18:58.554041 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:58.553968 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" event={"ID":"031bd02f-d377-4184-bc0f-036faceb352f","Type":"ContainerStarted","Data":"0d944793d5af69c5406c4f4714d879df86f20ec92f7ee73a0b25fe0b8d53e140"} Jun 05 21:18:58.555550 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:58.555513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rbskn" event={"ID":"c2d18026-5f50-4cbc-ada6-4da9f854c723","Type":"ContainerStarted","Data":"7d726778fc1b55bb9f6f1af2298677791698463a3062bed2588074b58749368b"} Jun 05 21:18:58.574880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:58.574827 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rbskn" podStartSLOduration=5.023268577 podStartE2EDuration="23.574809975s" totalImagesPullingTime="18.551541398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:58.574160759 +0000 UTC m=+23.642570657" watchObservedRunningTime="2026-06-05 21:18:58.574809975 +0000 UTC m=+23.643219870" Jun 05 21:18:58.575555 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:58.575525 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-crm5k" podStartSLOduration=5.023775572 podStartE2EDuration="23.575513758s" totalImagesPullingTime="18.551738186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:57.667510446 +0000 UTC m=+22.735920345" watchObservedRunningTime="2026-06-05 21:18:58.575513758 +0000 UTC m=+23.643923675" Jun 05 21:18:59.314646 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:59.314611 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:59.315234 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:59.315216 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:59.432082 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:59.431999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:18:59.432229 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:59.431994 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:18:59.432229 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:59.432116 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:18:59.432229 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:59.432128 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:18:59.432229 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:59.432214 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:18:59.432453 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:18:59.432277 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:18:59.560264 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:59.560228 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" event={"ID":"031bd02f-d377-4184-bc0f-036faceb352f","Type":"ContainerStarted","Data":"fbbfae3134169771b5d377f6b9a7145a91a77d63d3fd61bcd95fca2ba81eab8e"} Jun 05 21:18:59.565404 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:59.565360 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:59.565770 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:59.565750 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fxwsz" Jun 05 21:18:59.580808 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:18:59.580765 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496rc" podStartSLOduration=4.133943761 podStartE2EDuration="24.580749139s" totalImagesPullingTime="20.446805378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:18:59.580519854 +0000 UTC m=+24.648929753" watchObservedRunningTime="2026-06-05 21:18:59.580749139 +0000 UTC m=+24.649159038" Jun 05 21:19:00.569750 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:00.569718 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" event={"ID":"09ef593f-65c0-474d-860a-99ba154e842d","Type":"ContainerStarted","Data":"b908ca87e585a628e39163ba0acc922c38796167e2260c5ce87b05e72d41d595"} Jun 05 21:19:01.432606 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:01.432570 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:01.432779 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:01.432570 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:01.435656 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:01.432570 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:19:01.435656 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:01.433145 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:19:01.435656 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:01.433150 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:19:01.435656 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:01.433354 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:19:02.579043 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:02.578775 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" event={"ID":"09ef593f-65c0-474d-860a-99ba154e842d","Type":"ContainerStarted","Data":"c60f70da1189e7409352481e76817b44879ca2608bddd06b54faf91b771b9ed0"} Jun 05 21:19:02.579688 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:02.579107 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:19:02.579688 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:02.579160 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:19:02.596680 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:02.596650 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:19:02.605275 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:02.605219 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" podStartSLOduration=8.95036731 podStartE2EDuration="27.605203754s" totalImagesPullingTime="18.654836444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:02.604597916 +0000 UTC m=+27.673007814" watchObservedRunningTime="2026-06-05 21:19:02.605203754 +0000 UTC m=+27.673613675" Jun 05 21:19:03.432573 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.432545 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:19:03.432573 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.432576 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:03.432774 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.432551 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:03.432774 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:03.432673 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:19:03.432774 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:03.432754 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:19:03.432939 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:03.432832 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:19:03.583492 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.583461 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" event={"ID":"d3dee655-6d78-4584-a7b4-dc8b54feeca8","Type":"ContainerStarted","Data":"9ecd8171c0828b2bd80a170faf6eed2c2e69495468a819b239f94356b046375e"} Jun 05 21:19:03.583988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.583970 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:19:03.599601 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.599560 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-78t2z"] Jun 05 21:19:03.599739 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.599671 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:03.599776 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:03.599760 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:19:03.600773 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.600750 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:19:03.607512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.604958 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xp69c"] Jun 05 21:19:03.607512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.605114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:03.607512 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:03.605244 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:19:03.607512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.605562 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fpmnj"] Jun 05 21:19:03.607512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:03.605685 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:19:03.607512 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:03.605813 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:19:04.587788 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:04.587756 2567 generic.go:356] "Generic (PLEG): container finished" podID="d3dee655-6d78-4584-a7b4-dc8b54feeca8" containerID="9ecd8171c0828b2bd80a170faf6eed2c2e69495468a819b239f94356b046375e" exitCode=0 Jun 05 21:19:04.588165 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:04.587839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" event={"ID":"d3dee655-6d78-4584-a7b4-dc8b54feeca8","Type":"ContainerDied","Data":"9ecd8171c0828b2bd80a170faf6eed2c2e69495468a819b239f94356b046375e"} Jun 05 21:19:05.432930 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:05.432670 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:05.433131 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:05.432729 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:19:05.433131 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:05.432980 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:19:05.433131 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:05.432763 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:05.433131 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:05.433051 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:19:05.433413 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:05.433152 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:19:06.594183 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:06.594147 2567 generic.go:356] "Generic (PLEG): container finished" podID="d3dee655-6d78-4584-a7b4-dc8b54feeca8" containerID="3d87ec36b2d78b9a4ce376cba54b4e952c67aa42a717e9940c90eb461327d827" exitCode=0 Jun 05 21:19:06.594866 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:06.594207 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" event={"ID":"d3dee655-6d78-4584-a7b4-dc8b54feeca8","Type":"ContainerDied","Data":"3d87ec36b2d78b9a4ce376cba54b4e952c67aa42a717e9940c90eb461327d827"} Jun 05 21:19:07.432683 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:07.432651 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:19:07.432865 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:07.432778 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:07.432865 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:07.432791 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:19:07.432968 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:07.432875 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:19:07.432968 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:07.432924 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:07.433062 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:07.432973 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:19:08.600638 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:08.600605 2567 generic.go:356] "Generic (PLEG): container finished" podID="d3dee655-6d78-4584-a7b4-dc8b54feeca8" containerID="0251633abbb949879a346ac753980c27c6c30bc06a3727a0327fc73adfb7678c" exitCode=0 Jun 05 21:19:08.601215 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:08.600669 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" event={"ID":"d3dee655-6d78-4584-a7b4-dc8b54feeca8","Type":"ContainerDied","Data":"0251633abbb949879a346ac753980c27c6c30bc06a3727a0327fc73adfb7678c"} Jun 05 21:19:09.123594 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.123539 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:19:09.123774 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.123709 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:19:09.123844 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.123785 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs podName:aa53bf6c-8b56-457a-9ccd-ccd794dc48a8 nodeName:}" failed. No retries permitted until 2026-06-05 21:19:41.123766994 +0000 UTC m=+66.192176871 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs") pod "network-metrics-daemon-fpmnj" (UID: "aa53bf6c-8b56-457a-9ccd-ccd794dc48a8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 21:19:09.224420 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.224380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:09.224589 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.224547 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 21:19:09.224640 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.224615 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret podName:e78fba84-c3e9-4148-992b-5db59929d675 nodeName:}" failed. No retries permitted until 2026-06-05 21:19:41.224599228 +0000 UTC m=+66.293009108 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret") pod "global-pull-secret-syncer-78t2z" (UID: "e78fba84-c3e9-4148-992b-5db59929d675") : object "kube-system"/"original-pull-secret" not registered Jun 05 21:19:09.325521 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.325489 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:09.325703 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.325625 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 21:19:09.325703 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.325640 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 21:19:09.325703 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.325649 2567 projected.go:196] Error preparing data for projected volume kube-api-access-qhh8s for pod openshift-network-diagnostics/network-check-target-xp69c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:19:09.325818 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.325711 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s podName:b2aef670-d15f-41ca-a1d2-ea0781cda092 nodeName:}" failed. No retries permitted until 2026-06-05 21:19:41.32569135 +0000 UTC m=+66.394101250 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qhh8s" (UniqueName: "kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s") pod "network-check-target-xp69c" (UID: "b2aef670-d15f-41ca-a1d2-ea0781cda092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 21:19:09.432175 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.432092 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:09.432175 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.432116 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:09.432402 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.432092 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:19:09.432402 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.432220 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-78t2z" podUID="e78fba84-c3e9-4148-992b-5db59929d675" Jun 05 21:19:09.432402 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.432367 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:19:09.432520 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:09.432456 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xp69c" podUID="b2aef670-d15f-41ca-a1d2-ea0781cda092" Jun 05 21:19:09.728102 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.728010 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-234.ec2.internal" event="NodeReady" Jun 05 21:19:09.728561 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.728171 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 21:19:09.771150 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.771112 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5889d45f-xmtnq"] Jun 05 21:19:09.796675 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.795952 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c85sh"] Jun 05 21:19:09.796675 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.796154 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:09.799162 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.799123 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 21:19:09.799299 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.799130 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 21:19:09.799299 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.799223 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k5klj\"" Jun 05 21:19:09.800414 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.800172 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 21:19:09.804853 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.804791 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 21:19:09.811998 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.811977 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qvw5m"] Jun 05 21:19:09.812138 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.812119 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c85sh" Jun 05 21:19:09.815199 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.815177 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 21:19:09.815302 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.815280 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2p6vl\"" Jun 05 21:19:09.815389 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.815350 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 21:19:09.815458 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.815405 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 21:19:09.833474 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.833450 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5889d45f-xmtnq"] Jun 05 21:19:09.833474 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.833482 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c85sh"] Jun 05 21:19:09.833664 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.833497 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvw5m"] Jun 05 21:19:09.833664 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.833579 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:09.836286 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.836257 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 21:19:09.836416 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.836293 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 21:19:09.836416 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.836302 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6hvj9\"" Jun 05 21:19:09.927934 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.927899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-tmp-dir\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:09.928123 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.927962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-certificates\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:09.928123 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928032 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6dp\" (UniqueName: \"kubernetes.io/projected/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-kube-api-access-6h6dp\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:09.928123 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928077 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:09.928123 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-ca-trust-extracted\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:09.928299 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928148 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksp2d\" (UniqueName: \"kubernetes.io/projected/54379baf-13d5-418c-acea-be62ec48b079-kube-api-access-ksp2d\") pod \"ingress-canary-c85sh\" (UID: \"54379baf-13d5-418c-acea-be62ec48b079\") " pod="openshift-ingress-canary/ingress-canary-c85sh" Jun 05 21:19:09.928299 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928171 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-trusted-ca\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:09.928299 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-installation-pull-secrets\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:09.928299 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928218 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn89d\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-kube-api-access-mn89d\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:09.928494 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54379baf-13d5-418c-acea-be62ec48b079-cert\") pod \"ingress-canary-c85sh\" (UID: \"54379baf-13d5-418c-acea-be62ec48b079\") " pod="openshift-ingress-canary/ingress-canary-c85sh" Jun 05 21:19:09.928494 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928349 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-image-registry-private-configuration\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:09.928494 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928378 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-bound-sa-token\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:09.928494 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-config-volume\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:09.928494 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:09.928411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:10.029269 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-ca-trust-extracted\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.029455 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029283 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksp2d\" (UniqueName: \"kubernetes.io/projected/54379baf-13d5-418c-acea-be62ec48b079-kube-api-access-ksp2d\") pod \"ingress-canary-c85sh\" (UID: \"54379baf-13d5-418c-acea-be62ec48b079\") " pod="openshift-ingress-canary/ingress-canary-c85sh" Jun 05 21:19:10.029455 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-trusted-ca\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.029455 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-installation-pull-secrets\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.029455 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn89d\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-kube-api-access-mn89d\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.029455 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029450 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54379baf-13d5-418c-acea-be62ec48b079-cert\") pod \"ingress-canary-c85sh\" (UID: \"54379baf-13d5-418c-acea-be62ec48b079\") " pod="openshift-ingress-canary/ingress-canary-c85sh" Jun 05 21:19:10.029744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029477 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-image-registry-private-configuration\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.029744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-bound-sa-token\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.029744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-config-volume\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:10.029744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:10.029744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-tmp-dir\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:10.029744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-certificates\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.029744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6dp\" (UniqueName: \"kubernetes.io/projected/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-kube-api-access-6h6dp\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:10.029744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.029744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.029724 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-ca-trust-extracted\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.030239 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.029761 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:19:10.030239 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.029776 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5889d45f-xmtnq: secret "image-registry-tls" not found Jun 05 21:19:10.030239 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.029828 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls podName:87937b3e-5e2c-4f19-a86d-9ce1cb449e5c nodeName:}" failed. No retries permitted until 2026-06-05 21:19:10.529810508 +0000 UTC m=+35.598220386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls") pod "image-registry-5889d45f-xmtnq" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c") : secret "image-registry-tls" not found Jun 05 21:19:10.030239 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.030017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-tmp-dir\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:10.030474 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.030280 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:10.030474 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.030373 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls podName:ebede3cb-2f3e-4d4b-83ae-909de1f9e78b nodeName:}" failed. No retries permitted until 2026-06-05 21:19:10.530352836 +0000 UTC m=+35.598762724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls") pod "dns-default-qvw5m" (UID: "ebede3cb-2f3e-4d4b-83ae-909de1f9e78b") : secret "dns-default-metrics-tls" not found Jun 05 21:19:10.030474 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.030446 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-trusted-ca\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.030635 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.030550 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-config-volume\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:10.030635 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.030580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-certificates\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.034274 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.034242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-image-registry-private-configuration\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.034415 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.034249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-installation-pull-secrets\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.034415 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.034248 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54379baf-13d5-418c-acea-be62ec48b079-cert\") pod \"ingress-canary-c85sh\" (UID: \"54379baf-13d5-418c-acea-be62ec48b079\") " pod="openshift-ingress-canary/ingress-canary-c85sh" Jun 05 21:19:10.038794 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.038767 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn89d\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-kube-api-access-mn89d\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.039165 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.039146 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-bound-sa-token\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.039542 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.039520 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6dp\" (UniqueName: \"kubernetes.io/projected/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-kube-api-access-6h6dp\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:10.039667 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.039650 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksp2d\" (UniqueName: \"kubernetes.io/projected/54379baf-13d5-418c-acea-be62ec48b079-kube-api-access-ksp2d\") pod \"ingress-canary-c85sh\" (UID: \"54379baf-13d5-418c-acea-be62ec48b079\") " pod="openshift-ingress-canary/ingress-canary-c85sh" Jun 05 21:19:10.122023 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.121983 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c85sh" Jun 05 21:19:10.324936 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.324810 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c85sh"] Jun 05 21:19:10.328751 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:19:10.328718 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54379baf_13d5_418c_acea_be62ec48b079.slice/crio-51e5e84ace31b951709a0953cac82ed39f2010367aed7cd7b1a56a3497f80f13 WatchSource:0}: Error finding container 51e5e84ace31b951709a0953cac82ed39f2010367aed7cd7b1a56a3497f80f13: Status 404 returned error can't find the container with id 51e5e84ace31b951709a0953cac82ed39f2010367aed7cd7b1a56a3497f80f13 Jun 05 21:19:10.533122 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.533087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:10.533365 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.533133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:10.533365 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.533249 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:19:10.533365 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.533250 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:10.533365 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.533261 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5889d45f-xmtnq: secret "image-registry-tls" not found Jun 05 21:19:10.533365 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.533365 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls podName:ebede3cb-2f3e-4d4b-83ae-909de1f9e78b nodeName:}" failed. No retries permitted until 2026-06-05 21:19:11.533344379 +0000 UTC m=+36.601754271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls") pod "dns-default-qvw5m" (UID: "ebede3cb-2f3e-4d4b-83ae-909de1f9e78b") : secret "dns-default-metrics-tls" not found Jun 05 21:19:10.533633 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:10.533391 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls podName:87937b3e-5e2c-4f19-a86d-9ce1cb449e5c nodeName:}" failed. No retries permitted until 2026-06-05 21:19:11.533375364 +0000 UTC m=+36.601785260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls") pod "image-registry-5889d45f-xmtnq" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c") : secret "image-registry-tls" not found Jun 05 21:19:10.606955 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:10.606877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c85sh" event={"ID":"54379baf-13d5-418c-acea-be62ec48b079","Type":"ContainerStarted","Data":"51e5e84ace31b951709a0953cac82ed39f2010367aed7cd7b1a56a3497f80f13"} Jun 05 21:19:11.432483 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.432448 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:11.432979 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.432449 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:11.432979 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.432591 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:19:11.435105 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.435049 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 21:19:11.435244 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.435177 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 21:19:11.435310 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.435278 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 21:19:11.436220 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.436199 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 21:19:11.436317 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.436199 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jrpm8\"" Jun 05 21:19:11.436404 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.436361 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6kmjr\"" Jun 05 21:19:11.541851 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.541815 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:11.542042 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:11.541934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:11.542042 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:11.541975 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:19:11.542042 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:11.541992 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5889d45f-xmtnq: secret "image-registry-tls" not found Jun 05 21:19:11.542042 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:11.542027 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:11.542259 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:11.542051 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls podName:87937b3e-5e2c-4f19-a86d-9ce1cb449e5c nodeName:}" failed. No retries permitted until 2026-06-05 21:19:13.542031902 +0000 UTC m=+38.610441799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls") pod "image-registry-5889d45f-xmtnq" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c") : secret "image-registry-tls" not found Jun 05 21:19:11.542259 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:11.542067 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls podName:ebede3cb-2f3e-4d4b-83ae-909de1f9e78b nodeName:}" failed. No retries permitted until 2026-06-05 21:19:13.542059071 +0000 UTC m=+38.610468947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls") pod "dns-default-qvw5m" (UID: "ebede3cb-2f3e-4d4b-83ae-909de1f9e78b") : secret "dns-default-metrics-tls" not found Jun 05 21:19:13.558443 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:13.558404 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:13.558804 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:13.558459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:13.558804 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:13.558551 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:13.558804 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:13.558615 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls podName:ebede3cb-2f3e-4d4b-83ae-909de1f9e78b nodeName:}" failed. No retries permitted until 2026-06-05 21:19:17.558599342 +0000 UTC m=+42.627009218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls") pod "dns-default-qvw5m" (UID: "ebede3cb-2f3e-4d4b-83ae-909de1f9e78b") : secret "dns-default-metrics-tls" not found Jun 05 21:19:13.558804 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:13.558557 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:19:13.558804 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:13.558653 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5889d45f-xmtnq: secret "image-registry-tls" not found Jun 05 21:19:13.558804 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:13.558692 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls podName:87937b3e-5e2c-4f19-a86d-9ce1cb449e5c nodeName:}" failed. No retries permitted until 2026-06-05 21:19:17.558680413 +0000 UTC m=+42.627090290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls") pod "image-registry-5889d45f-xmtnq" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c") : secret "image-registry-tls" not found Jun 05 21:19:14.619999 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:14.619790 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c85sh" event={"ID":"54379baf-13d5-418c-acea-be62ec48b079","Type":"ContainerStarted","Data":"8ae1944c58b870a770e1ee710547509e7a67d732b64ad48a78cb850ec2a20eaf"} Jun 05 21:19:14.622479 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:14.622448 2567 generic.go:356] "Generic (PLEG): container finished" podID="d3dee655-6d78-4584-a7b4-dc8b54feeca8" containerID="81a22e115c6ca385f959286dfda9237ab26388fb7afeb53677aa87415523ea92" exitCode=0 Jun 05 21:19:14.622583 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:14.622511 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" event={"ID":"d3dee655-6d78-4584-a7b4-dc8b54feeca8","Type":"ContainerDied","Data":"81a22e115c6ca385f959286dfda9237ab26388fb7afeb53677aa87415523ea92"} Jun 05 21:19:14.635510 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:14.635468 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c85sh" podStartSLOduration=2.348129364 podStartE2EDuration="5.635453077s" totalImagesPullingTime="3.287323713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:14.634788495 +0000 UTC m=+39.703198395" watchObservedRunningTime="2026-06-05 21:19:14.635453077 +0000 UTC m=+39.703862953" Jun 05 21:19:15.254426 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:15.254391 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:15.326442 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:15.326410 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:15.545459 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:15.545381 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:15.597337 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:15.597301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:15.627279 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:15.627247 2567 generic.go:356] "Generic (PLEG): container finished" podID="d3dee655-6d78-4584-a7b4-dc8b54feeca8" containerID="a414482ef9ac784d7453d7d120385f1eb489846f7f0534c9952ac1042e78ee55" exitCode=0 Jun 05 21:19:15.627814 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:15.627338 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" event={"ID":"d3dee655-6d78-4584-a7b4-dc8b54feeca8","Type":"ContainerDied","Data":"a414482ef9ac784d7453d7d120385f1eb489846f7f0534c9952ac1042e78ee55"} Jun 05 21:19:16.633166 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:16.633121 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" event={"ID":"d3dee655-6d78-4584-a7b4-dc8b54feeca8","Type":"ContainerStarted","Data":"f1e7d5263a3f0a079629c47732c9bbc76ca08e61660a870d46a620add3425c3b"} Jun 05 21:19:16.655383 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:16.655309 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vtt5b" podStartSLOduration=14.62390397 podStartE2EDuration="41.655293532s" totalImagesPullingTime="27.031389562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:16.653619059 +0000 UTC m=+41.722028957" watchObservedRunningTime="2026-06-05 21:19:16.655293532 +0000 UTC m=+41.723703433" Jun 05 21:19:16.774474 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:16.774440 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:16.824368 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:16.824312 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:16.967368 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:16.967279 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:17.066960 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:17.066922 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:17.591554 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:17.591504 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:17.591554 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:17.591571 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:17.591785 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:17.591672 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:19:17.591785 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:17.591688 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5889d45f-xmtnq: secret "image-registry-tls" not found Jun 05 21:19:17.591785 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:17.591733 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls podName:87937b3e-5e2c-4f19-a86d-9ce1cb449e5c nodeName:}" failed. No retries permitted until 2026-06-05 21:19:25.591720208 +0000 UTC m=+50.660130085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls") pod "image-registry-5889d45f-xmtnq" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c") : secret "image-registry-tls" not found Jun 05 21:19:17.591785 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:17.591672 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:17.591919 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:17.591815 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls podName:ebede3cb-2f3e-4d4b-83ae-909de1f9e78b nodeName:}" failed. No retries permitted until 2026-06-05 21:19:25.591801008 +0000 UTC m=+50.660210884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls") pod "dns-default-qvw5m" (UID: "ebede3cb-2f3e-4d4b-83ae-909de1f9e78b") : secret "dns-default-metrics-tls" not found Jun 05 21:19:24.406538 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:24.406501 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:24.454793 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:24.454763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:25.547625 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:25.547595 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:25.606543 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:25.606513 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:25.650210 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:25.650176 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:25.650318 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:25.650247 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:25.650382 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:25.650346 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:19:25.650382 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:25.650367 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5889d45f-xmtnq: secret "image-registry-tls" not found Jun 05 21:19:25.650446 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:25.650417 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls podName:87937b3e-5e2c-4f19-a86d-9ce1cb449e5c nodeName:}" failed. No retries permitted until 2026-06-05 21:19:41.650401754 +0000 UTC m=+66.718811630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls") pod "image-registry-5889d45f-xmtnq" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c") : secret "image-registry-tls" not found Jun 05 21:19:25.650446 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:25.650349 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:25.650517 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:25.650480 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls podName:ebede3cb-2f3e-4d4b-83ae-909de1f9e78b nodeName:}" failed. No retries permitted until 2026-06-05 21:19:41.650466169 +0000 UTC m=+66.718876053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls") pod "dns-default-qvw5m" (UID: "ebede3cb-2f3e-4d4b-83ae-909de1f9e78b") : secret "dns-default-metrics-tls" not found Jun 05 21:19:25.787776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:25.787745 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:25.837499 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:25.837425 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:35.604831 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:35.604804 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwg78" Jun 05 21:19:35.752690 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:35.752654 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:35.805830 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:35.805794 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:37.539582 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:37.539528 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:37.595303 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:37.595275 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:41.158311 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.158259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:19:41.160828 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.160806 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 21:19:41.168868 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:41.168847 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:19:41.168931 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:41.168920 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs podName:aa53bf6c-8b56-457a-9ccd-ccd794dc48a8 nodeName:}" failed. No retries permitted until 2026-06-05 21:20:45.168896009 +0000 UTC m=+130.237305886 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs") pod "network-metrics-daemon-fpmnj" (UID: "aa53bf6c-8b56-457a-9ccd-ccd794dc48a8") : secret "metrics-daemon-secret" not found Jun 05 21:19:41.258644 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.258605 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:41.261592 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.261576 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 21:19:41.273146 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.273114 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e78fba84-c3e9-4148-992b-5db59929d675-original-pull-secret\") pod \"global-pull-secret-syncer-78t2z\" (UID: \"e78fba84-c3e9-4148-992b-5db59929d675\") " pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:41.359105 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.359063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:41.362043 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.362021 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 21:19:41.372714 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.372686 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 21:19:41.383134 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.383111 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhh8s\" (UniqueName: \"kubernetes.io/projected/b2aef670-d15f-41ca-a1d2-ea0781cda092-kube-api-access-qhh8s\") pod \"network-check-target-xp69c\" (UID: \"b2aef670-d15f-41ca-a1d2-ea0781cda092\") " pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:41.444194 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.444117 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-78t2z" Jun 05 21:19:41.453949 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.453917 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jrpm8\"" Jun 05 21:19:41.461382 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.461358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:41.584748 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.584717 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-78t2z"] Jun 05 21:19:41.588724 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:19:41.588688 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78fba84_c3e9_4148_992b_5db59929d675.slice/crio-c3683308bd6148c1ae2179a993a7f393f99d1c8adda8b2103e87933c4ef2d7b3 WatchSource:0}: Error finding container c3683308bd6148c1ae2179a993a7f393f99d1c8adda8b2103e87933c4ef2d7b3: Status 404 returned error can't find the container with id c3683308bd6148c1ae2179a993a7f393f99d1c8adda8b2103e87933c4ef2d7b3 Jun 05 21:19:41.616872 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.616843 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xp69c"] Jun 05 21:19:41.619495 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:19:41.619465 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2aef670_d15f_41ca_a1d2_ea0781cda092.slice/crio-e321d55763d6743758083f13cfd1310a2c4afd6a81209780d85de84eb00bb0f4 WatchSource:0}: Error finding container e321d55763d6743758083f13cfd1310a2c4afd6a81209780d85de84eb00bb0f4: Status 404 returned error can't find the container with id e321d55763d6743758083f13cfd1310a2c4afd6a81209780d85de84eb00bb0f4 Jun 05 21:19:41.662636 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.662598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:19:41.662811 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.662662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:19:41.662811 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:41.662776 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:19:41.662811 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:41.662799 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5889d45f-xmtnq: secret "image-registry-tls" not found Jun 05 21:19:41.662914 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:41.662863 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls podName:87937b3e-5e2c-4f19-a86d-9ce1cb449e5c nodeName:}" failed. No retries permitted until 2026-06-05 21:20:13.66284757 +0000 UTC m=+98.731257451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls") pod "image-registry-5889d45f-xmtnq" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c") : secret "image-registry-tls" not found Jun 05 21:19:41.662914 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:41.662864 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:19:41.662982 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:19:41.662913 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls podName:ebede3cb-2f3e-4d4b-83ae-909de1f9e78b nodeName:}" failed. No retries permitted until 2026-06-05 21:20:13.662901136 +0000 UTC m=+98.731311013 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls") pod "dns-default-qvw5m" (UID: "ebede3cb-2f3e-4d4b-83ae-909de1f9e78b") : secret "dns-default-metrics-tls" not found Jun 05 21:19:41.693476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.693442 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-78t2z" event={"ID":"e78fba84-c3e9-4148-992b-5db59929d675","Type":"ContainerStarted","Data":"c3683308bd6148c1ae2179a993a7f393f99d1c8adda8b2103e87933c4ef2d7b3"} Jun 05 21:19:41.694454 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:41.694390 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xp69c" event={"ID":"b2aef670-d15f-41ca-a1d2-ea0781cda092","Type":"ContainerStarted","Data":"e321d55763d6743758083f13cfd1310a2c4afd6a81209780d85de84eb00bb0f4"} Jun 05 21:19:45.707985 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:45.707946 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xp69c" event={"ID":"b2aef670-d15f-41ca-a1d2-ea0781cda092","Type":"ContainerStarted","Data":"fd421b929d5a090b87d1c9b584d9c8ce6c73d96563210ed2c3c3444f0d04870c"} Jun 05 21:19:45.708451 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:45.708077 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:19:45.724529 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:45.724470 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xp69c" podStartSLOduration=67.679998658 podStartE2EDuration="1m10.72445034s" totalImagesPullingTime="3.044451682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:45.722668286 +0000 UTC m=+70.791078186" watchObservedRunningTime="2026-06-05 21:19:45.72445034 +0000 UTC m=+70.792860239" Jun 05 21:19:46.356562 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:46.356519 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:46.409873 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:46.409849 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:46.711720 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:46.711622 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-78t2z" event={"ID":"e78fba84-c3e9-4148-992b-5db59929d675","Type":"ContainerStarted","Data":"d0a5ed94ea28b1f6104fe807194f853cd396ff52ff06ddda56ac63eaf700e6a2"} Jun 05 21:19:46.727282 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:46.727232 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-78t2z" podStartSLOduration=66.994079701 podStartE2EDuration="1m11.72721694s" totalImagesPullingTime="4.733137239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:19:46.726862031 +0000 UTC m=+71.795271946" watchObservedRunningTime="2026-06-05 21:19:46.72721694 +0000 UTC m=+71.795626838" Jun 05 21:19:49.947136 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:49.947103 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:50.050274 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:19:50.050247 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:13.699053 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:20:13.699004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:20:13.699584 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:20:13.699154 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:20:13.699584 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:20:13.699219 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls podName:ebede3cb-2f3e-4d4b-83ae-909de1f9e78b nodeName:}" failed. No retries permitted until 2026-06-05 21:21:17.699202184 +0000 UTC m=+162.767612064 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls") pod "dns-default-qvw5m" (UID: "ebede3cb-2f3e-4d4b-83ae-909de1f9e78b") : secret "dns-default-metrics-tls" not found Jun 05 21:20:13.699584 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:20:13.699160 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:20:13.699584 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:20:13.699255 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:20:13.699584 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:20:13.699271 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5889d45f-xmtnq: secret "image-registry-tls" not found Jun 05 21:20:13.699584 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:20:13.699323 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls podName:87937b3e-5e2c-4f19-a86d-9ce1cb449e5c nodeName:}" failed. No retries permitted until 2026-06-05 21:21:17.699306632 +0000 UTC m=+162.767716523 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls") pod "image-registry-5889d45f-xmtnq" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c") : secret "image-registry-tls" not found Jun 05 21:20:16.714553 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:20:16.714523 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xp69c" Jun 05 21:20:45.220927 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:20:45.220884 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:20:45.221436 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:20:45.221046 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:20:45.221436 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:20:45.221128 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs podName:aa53bf6c-8b56-457a-9ccd-ccd794dc48a8 nodeName:}" failed. No retries permitted until 2026-06-05 21:22:47.221112447 +0000 UTC m=+252.289522327 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs") pod "network-metrics-daemon-fpmnj" (UID: "aa53bf6c-8b56-457a-9ccd-ccd794dc48a8") : secret "metrics-daemon-secret" not found Jun 05 21:21:12.809021 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:12.808925 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" podUID="87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" Jun 05 21:21:12.843579 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:12.843527 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qvw5m" podUID="ebede3cb-2f3e-4d4b-83ae-909de1f9e78b" Jun 05 21:21:12.910401 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:12.910378 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:21:12.910533 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:12.910383 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvw5m" Jun 05 21:21:14.458137 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:14.458093 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fpmnj" podUID="aa53bf6c-8b56-457a-9ccd-ccd794dc48a8" Jun 05 21:21:15.868555 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:15.868515 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:17.746450 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:17.746407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:21:17.746938 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:17.746462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:21:17.746938 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:17.746547 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:21:17.746938 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:17.746546 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:21:17.746938 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:17.746621 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls podName:ebede3cb-2f3e-4d4b-83ae-909de1f9e78b nodeName:}" failed. No retries permitted until 2026-06-05 21:23:19.746605505 +0000 UTC m=+284.815015383 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls") pod "dns-default-qvw5m" (UID: "ebede3cb-2f3e-4d4b-83ae-909de1f9e78b") : secret "dns-default-metrics-tls" not found Jun 05 21:21:17.746938 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:17.746557 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5889d45f-xmtnq: secret "image-registry-tls" not found Jun 05 21:21:17.746938 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:17.746696 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls podName:87937b3e-5e2c-4f19-a86d-9ce1cb449e5c nodeName:}" failed. No retries permitted until 2026-06-05 21:23:19.746681974 +0000 UTC m=+284.815091862 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls") pod "image-registry-5889d45f-xmtnq" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c") : secret "image-registry-tls" not found Jun 05 21:21:26.432139 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:26.432090 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:21:33.467579 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:33.467537 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:52.549431 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.549393 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq"] Jun 05 21:21:52.552191 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.552172 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.553514 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.553485 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x"] Jun 05 21:21:52.554795 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.554777 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 05 21:21:52.554902 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.554883 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 05 21:21:52.555048 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.555031 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-r4thn\"" Jun 05 21:21:52.555101 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.555060 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 05 21:21:52.555705 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.555687 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:21:52.556301 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.556286 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7"] Jun 05 21:21:52.556425 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.556411 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:21:52.558953 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.558917 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 21:21:52.559124 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.559104 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:21:52.561001 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.560978 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qqpns\"" Jun 05 21:21:52.561108 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.561011 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:21:52.561108 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.561005 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 21:21:52.561634 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.561621 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 05 21:21:52.562177 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.562163 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wlj6n\"" Jun 05 21:21:52.565405 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.565379 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 05 21:21:52.566836 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.566816 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq"] Jun 05 21:21:52.568655 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.568622 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7"] Jun 05 21:21:52.571260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.571238 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x"] Jun 05 21:21:52.590046 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.590012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:21:52.590046 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.590048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzr9k\" (UniqueName: \"kubernetes.io/projected/06ad3e2f-8a4f-41ef-b298-45f6160a5946-kube-api-access-tzr9k\") pod \"service-ca-operator-6bc5ff68f5-hfcjq\" (UID: \"06ad3e2f-8a4f-41ef-b298-45f6160a5946\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.590252 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.590126 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9zpk\" (UniqueName: \"kubernetes.io/projected/58350d01-46ae-418a-94f5-d8a7641656ba-kube-api-access-j9zpk\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:21:52.590252 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.590173 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/982f450a-3056-4773-b6f4-a5f026cde0fb-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:21:52.590252 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.590204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06ad3e2f-8a4f-41ef-b298-45f6160a5946-config\") pod \"service-ca-operator-6bc5ff68f5-hfcjq\" (UID: \"06ad3e2f-8a4f-41ef-b298-45f6160a5946\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.590426 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.590284 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06ad3e2f-8a4f-41ef-b298-45f6160a5946-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hfcjq\" (UID: \"06ad3e2f-8a4f-41ef-b298-45f6160a5946\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.590426 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.590343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:21:52.649241 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.649207 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p"] Jun 05 21:21:52.654630 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.654595 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-4dwkt"] Jun 05 21:21:52.654793 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.654723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p" Jun 05 21:21:52.657043 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.657020 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:21:52.657155 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.657026 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 05 21:21:52.657510 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.657494 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp"] Jun 05 21:21:52.657602 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.657588 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.657767 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.657748 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lsdf2\"" Jun 05 21:21:52.660075 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.660058 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dw9c6\"" Jun 05 21:21:52.660270 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.660253 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 21:21:52.660462 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.660439 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6478957989-b8l59"] Jun 05 21:21:52.660592 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.660575 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.660660 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.660605 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 05 21:21:52.660718 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.660661 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 21:21:52.661249 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.661229 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 05 21:21:52.663698 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.663680 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 21:21:52.663835 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.663712 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:21:52.663913 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.663869 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 21:21:52.664053 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.664030 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d4kjp\"" Jun 05 21:21:52.664423 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.664404 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 21:21:52.664522 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.664448 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p"] Jun 05 21:21:52.664588 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.664540 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.666521 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.666496 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 05 21:21:52.667508 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.667485 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 21:21:52.667611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.667592 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 21:21:52.667802 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.667783 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 21:21:52.668212 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.668192 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 21:21:52.668567 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.668545 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kzkl2\"" Jun 05 21:21:52.668659 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.668547 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 21:21:52.668803 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.668786 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 21:21:52.668952 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.668936 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4dwkt"] Jun 05 21:21:52.670060 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.670038 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp"] Jun 05 21:21:52.691655 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.691623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-serving-cert\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.691799 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.691660 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-trusted-ca-bundle\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.691799 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.691698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/982f450a-3056-4773-b6f4-a5f026cde0fb-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:21:52.691799 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.691760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06ad3e2f-8a4f-41ef-b298-45f6160a5946-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hfcjq\" (UID: \"06ad3e2f-8a4f-41ef-b298-45f6160a5946\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.691799 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.691789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-service-ca-bundle\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.692003 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.691820 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:21:52.692003 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.691858 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzr9k\" (UniqueName: \"kubernetes.io/projected/06ad3e2f-8a4f-41ef-b298-45f6160a5946-kube-api-access-tzr9k\") pod \"service-ca-operator-6bc5ff68f5-hfcjq\" (UID: \"06ad3e2f-8a4f-41ef-b298-45f6160a5946\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.692003 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.691898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-snapshots\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.692003 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:52.691944 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:21:52.692195 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:52.692010 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert podName:982f450a-3056-4773-b6f4-a5f026cde0fb nodeName:}" failed. No retries permitted until 2026-06-05 21:21:53.19199587 +0000 UTC m=+198.260405747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5gnm7" (UID: "982f450a-3056-4773-b6f4-a5f026cde0fb") : secret "networking-console-plugin-cert" not found Jun 05 21:21:52.692195 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.691943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9zpk\" (UniqueName: \"kubernetes.io/projected/58350d01-46ae-418a-94f5-d8a7641656ba-kube-api-access-j9zpk\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:21:52.692195 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.692075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-tmp\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.692195 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.692108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06ad3e2f-8a4f-41ef-b298-45f6160a5946-config\") pod \"service-ca-operator-6bc5ff68f5-hfcjq\" (UID: \"06ad3e2f-8a4f-41ef-b298-45f6160a5946\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.692195 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.692135 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbxk\" (UniqueName: \"kubernetes.io/projected/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-kube-api-access-jrbxk\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.692195 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.692159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb4gr\" (UniqueName: \"kubernetes.io/projected/31a3db22-0f4e-4bcb-8401-489e216e1e43-kube-api-access-jb4gr\") pod \"volume-data-source-validator-78dd696465-d6s9p\" (UID: \"31a3db22-0f4e-4bcb-8401-489e216e1e43\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p" Jun 05 21:21:52.692195 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.692193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:21:52.692475 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:52.692290 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:21:52.692475 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:52.692356 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls podName:58350d01-46ae-418a-94f5-d8a7641656ba nodeName:}" failed. No retries permitted until 2026-06-05 21:21:53.192339587 +0000 UTC m=+198.260749478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-z482x" (UID: "58350d01-46ae-418a-94f5-d8a7641656ba") : secret "samples-operator-tls" not found Jun 05 21:21:52.692475 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.692401 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/982f450a-3056-4773-b6f4-a5f026cde0fb-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:21:52.692616 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.692601 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06ad3e2f-8a4f-41ef-b298-45f6160a5946-config\") pod \"service-ca-operator-6bc5ff68f5-hfcjq\" (UID: \"06ad3e2f-8a4f-41ef-b298-45f6160a5946\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.694034 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.694014 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06ad3e2f-8a4f-41ef-b298-45f6160a5946-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hfcjq\" (UID: \"06ad3e2f-8a4f-41ef-b298-45f6160a5946\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.697484 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.697462 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6478957989-b8l59"] Jun 05 21:21:52.706228 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.706203 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzr9k\" (UniqueName: \"kubernetes.io/projected/06ad3e2f-8a4f-41ef-b298-45f6160a5946-kube-api-access-tzr9k\") pod \"service-ca-operator-6bc5ff68f5-hfcjq\" (UID: \"06ad3e2f-8a4f-41ef-b298-45f6160a5946\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.708096 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.708074 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9zpk\" (UniqueName: \"kubernetes.io/projected/58350d01-46ae-418a-94f5-d8a7641656ba-kube-api-access-j9zpk\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:21:52.753740 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.753706 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52"] Jun 05 21:21:52.757828 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.757806 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52" Jun 05 21:21:52.760261 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.760238 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5987n\"" Jun 05 21:21:52.764139 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.764114 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52"] Jun 05 21:21:52.792614 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792574 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-snapshots\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.792614 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792616 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp66j\" (UniqueName: \"kubernetes.io/projected/f11e295a-6920-43d2-9531-4fecbd010fd2-kube-api-access-tp66j\") pod \"network-check-source-dbd9cf844-n6d52\" (UID: \"f11e295a-6920-43d2-9531-4fecbd010fd2\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52" Jun 05 21:21:52.792853 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792644 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-tmp\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.792853 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792669 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbxk\" (UniqueName: \"kubernetes.io/projected/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-kube-api-access-jrbxk\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.792853 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb4gr\" (UniqueName: \"kubernetes.io/projected/31a3db22-0f4e-4bcb-8401-489e216e1e43-kube-api-access-jb4gr\") pod \"volume-data-source-validator-78dd696465-d6s9p\" (UID: \"31a3db22-0f4e-4bcb-8401-489e216e1e43\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p" Jun 05 21:21:52.792853 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792718 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/998edffc-37fa-4c24-bc4b-38af52c4a3f3-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g4jrp\" (UID: \"998edffc-37fa-4c24-bc4b-38af52c4a3f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.792853 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-serving-cert\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.792853 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-stats-auth\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.793093 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-trusted-ca-bundle\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.793093 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.793093 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/998edffc-37fa-4c24-bc4b-38af52c4a3f3-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g4jrp\" (UID: \"998edffc-37fa-4c24-bc4b-38af52c4a3f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.793093 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-default-certificate\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.793093 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.792994 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-service-ca-bundle\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.793093 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.793069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.793301 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.793119 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gzw\" (UniqueName: \"kubernetes.io/projected/998edffc-37fa-4c24-bc4b-38af52c4a3f3-kube-api-access-q2gzw\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g4jrp\" (UID: \"998edffc-37fa-4c24-bc4b-38af52c4a3f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.793301 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.793153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhsk2\" (UniqueName: \"kubernetes.io/projected/1461e6c9-bae6-4d82-8c47-381a5c59537e-kube-api-access-jhsk2\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.793403 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.793354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-tmp\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.793461 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.793442 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-snapshots\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.793716 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.793696 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-service-ca-bundle\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.794199 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.794181 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-trusted-ca-bundle\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.795122 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.795099 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-serving-cert\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.800595 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.800544 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbxk\" (UniqueName: \"kubernetes.io/projected/d65a3ec8-23f8-4538-abb4-5c7b904b19fa-kube-api-access-jrbxk\") pod \"insights-operator-896549976-4dwkt\" (UID: \"d65a3ec8-23f8-4538-abb4-5c7b904b19fa\") " pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.800688 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.800590 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb4gr\" (UniqueName: \"kubernetes.io/projected/31a3db22-0f4e-4bcb-8401-489e216e1e43-kube-api-access-jb4gr\") pod \"volume-data-source-validator-78dd696465-d6s9p\" (UID: \"31a3db22-0f4e-4bcb-8401-489e216e1e43\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p" Jun 05 21:21:52.845465 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.845434 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:52.862521 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.862479 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" Jun 05 21:21:52.893955 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.893918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gzw\" (UniqueName: \"kubernetes.io/projected/998edffc-37fa-4c24-bc4b-38af52c4a3f3-kube-api-access-q2gzw\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g4jrp\" (UID: \"998edffc-37fa-4c24-bc4b-38af52c4a3f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.893955 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.893957 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhsk2\" (UniqueName: \"kubernetes.io/projected/1461e6c9-bae6-4d82-8c47-381a5c59537e-kube-api-access-jhsk2\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.894196 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.894063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp66j\" (UniqueName: \"kubernetes.io/projected/f11e295a-6920-43d2-9531-4fecbd010fd2-kube-api-access-tp66j\") pod \"network-check-source-dbd9cf844-n6d52\" (UID: \"f11e295a-6920-43d2-9531-4fecbd010fd2\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52" Jun 05 21:21:52.894196 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.894106 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/998edffc-37fa-4c24-bc4b-38af52c4a3f3-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g4jrp\" (UID: \"998edffc-37fa-4c24-bc4b-38af52c4a3f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.894196 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.894149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-stats-auth\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.894196 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.894177 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.894548 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.894215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/998edffc-37fa-4c24-bc4b-38af52c4a3f3-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g4jrp\" (UID: \"998edffc-37fa-4c24-bc4b-38af52c4a3f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.894548 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:52.894301 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:21:52.894548 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:52.894387 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:21:53.394366821 +0000 UTC m=+198.462776699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : secret "router-metrics-certs-default" not found Jun 05 21:21:52.894548 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.894306 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-default-certificate\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.894548 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.894500 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.894805 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:52.894643 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:21:53.394622087 +0000 UTC m=+198.463031981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : configmap references non-existent config key: service-ca.crt Jun 05 21:21:52.894867 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.894803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/998edffc-37fa-4c24-bc4b-38af52c4a3f3-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g4jrp\" (UID: \"998edffc-37fa-4c24-bc4b-38af52c4a3f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.896674 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.896648 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-default-certificate\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.896892 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.896873 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/998edffc-37fa-4c24-bc4b-38af52c4a3f3-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g4jrp\" (UID: \"998edffc-37fa-4c24-bc4b-38af52c4a3f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.897021 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.897003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-stats-auth\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.901361 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.901286 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:52.902834 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.902796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gzw\" (UniqueName: \"kubernetes.io/projected/998edffc-37fa-4c24-bc4b-38af52c4a3f3-kube-api-access-q2gzw\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-g4jrp\" (UID: \"998edffc-37fa-4c24-bc4b-38af52c4a3f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.903028 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.903009 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp66j\" (UniqueName: \"kubernetes.io/projected/f11e295a-6920-43d2-9531-4fecbd010fd2-kube-api-access-tp66j\") pod \"network-check-source-dbd9cf844-n6d52\" (UID: \"f11e295a-6920-43d2-9531-4fecbd010fd2\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52" Jun 05 21:21:52.903070 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.903015 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhsk2\" (UniqueName: \"kubernetes.io/projected/1461e6c9-bae6-4d82-8c47-381a5c59537e-kube-api-access-jhsk2\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:52.966744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.966714 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p" Jun 05 21:21:52.974918 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.974900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-4dwkt" Jun 05 21:21:52.980753 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.980729 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" Jun 05 21:21:52.983069 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:52.983038 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq"] Jun 05 21:21:52.985863 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:21:52.985838 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ad3e2f_8a4f_41ef_b298_45f6160a5946.slice/crio-b5b8d5d50a8a6eb88f68ee4c4e7a826346438539b900f7308dba54f256c8d691 WatchSource:0}: Error finding container b5b8d5d50a8a6eb88f68ee4c4e7a826346438539b900f7308dba54f256c8d691: Status 404 returned error can't find the container with id b5b8d5d50a8a6eb88f68ee4c4e7a826346438539b900f7308dba54f256c8d691 Jun 05 21:21:53.008122 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.008079 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" event={"ID":"06ad3e2f-8a4f-41ef-b298-45f6160a5946","Type":"ContainerStarted","Data":"b5b8d5d50a8a6eb88f68ee4c4e7a826346438539b900f7308dba54f256c8d691"} Jun 05 21:21:53.067848 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.067809 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52" Jun 05 21:21:53.109975 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.109933 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p"] Jun 05 21:21:53.114420 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:21:53.114366 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a3db22_0f4e_4bcb_8401_489e216e1e43.slice/crio-96feda0823ce8f9bda7faff43a39fab8468552192f0a92f46dc4c87bbca3e960 WatchSource:0}: Error finding container 96feda0823ce8f9bda7faff43a39fab8468552192f0a92f46dc4c87bbca3e960: Status 404 returned error can't find the container with id 96feda0823ce8f9bda7faff43a39fab8468552192f0a92f46dc4c87bbca3e960 Jun 05 21:21:53.131918 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.131598 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-4dwkt"] Jun 05 21:21:53.137645 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:21:53.137604 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65a3ec8_23f8_4538_abb4_5c7b904b19fa.slice/crio-904cb794416c5a17e156e1b499cdd13eb8c67e9673d7860906ba314e0e92283f WatchSource:0}: Error finding container 904cb794416c5a17e156e1b499cdd13eb8c67e9673d7860906ba314e0e92283f: Status 404 returned error can't find the container with id 904cb794416c5a17e156e1b499cdd13eb8c67e9673d7860906ba314e0e92283f Jun 05 21:21:53.153689 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.153640 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp"] Jun 05 21:21:53.155865 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:21:53.155836 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998edffc_37fa_4c24_bc4b_38af52c4a3f3.slice/crio-6a3f8fe4904af0ba64e11901f6ab1c8f4deace87ffe9b8dd3fda2b80da6876ae WatchSource:0}: Error finding container 6a3f8fe4904af0ba64e11901f6ab1c8f4deace87ffe9b8dd3fda2b80da6876ae: Status 404 returned error can't find the container with id 6a3f8fe4904af0ba64e11901f6ab1c8f4deace87ffe9b8dd3fda2b80da6876ae Jun 05 21:21:53.197177 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.197145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:21:53.197361 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.197248 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:21:53.197361 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:53.197294 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:21:53.197452 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:53.197386 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert podName:982f450a-3056-4773-b6f4-a5f026cde0fb nodeName:}" failed. No retries permitted until 2026-06-05 21:21:54.197368948 +0000 UTC m=+199.265778852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5gnm7" (UID: "982f450a-3056-4773-b6f4-a5f026cde0fb") : secret "networking-console-plugin-cert" not found Jun 05 21:21:53.197452 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:53.197416 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:21:53.197524 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:53.197474 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls podName:58350d01-46ae-418a-94f5-d8a7641656ba nodeName:}" failed. No retries permitted until 2026-06-05 21:21:54.197461302 +0000 UTC m=+199.265871180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-z482x" (UID: "58350d01-46ae-418a-94f5-d8a7641656ba") : secret "samples-operator-tls" not found Jun 05 21:21:53.205929 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.205901 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52"] Jun 05 21:21:53.208690 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:21:53.208666 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11e295a_6920_43d2_9531_4fecbd010fd2.slice/crio-3a57dbf1ee9c7269f61cb06fb7316dc6ccc88306689ee9646bd21433f336623b WatchSource:0}: Error finding container 3a57dbf1ee9c7269f61cb06fb7316dc6ccc88306689ee9646bd21433f336623b: Status 404 returned error can't find the container with id 3a57dbf1ee9c7269f61cb06fb7316dc6ccc88306689ee9646bd21433f336623b Jun 05 21:21:53.399608 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.399515 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:53.399608 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:53.399594 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:53.399784 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:53.399668 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:21:53.399784 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:53.399732 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:21:54.399716485 +0000 UTC m=+199.468126367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : secret "router-metrics-certs-default" not found Jun 05 21:21:53.399784 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:53.399747 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:21:54.399741087 +0000 UTC m=+199.468150964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : configmap references non-existent config key: service-ca.crt Jun 05 21:21:54.014392 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.013477 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4dwkt" event={"ID":"d65a3ec8-23f8-4538-abb4-5c7b904b19fa","Type":"ContainerStarted","Data":"904cb794416c5a17e156e1b499cdd13eb8c67e9673d7860906ba314e0e92283f"} Jun 05 21:21:54.016745 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.016280 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" event={"ID":"998edffc-37fa-4c24-bc4b-38af52c4a3f3","Type":"ContainerStarted","Data":"6a3f8fe4904af0ba64e11901f6ab1c8f4deace87ffe9b8dd3fda2b80da6876ae"} Jun 05 21:21:54.021368 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.021100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52" event={"ID":"f11e295a-6920-43d2-9531-4fecbd010fd2","Type":"ContainerStarted","Data":"71d3eca0ad019ebddbf5e71f5026f38bc34ab4aa8d50ee12a1b777f8aeea9d36"} Jun 05 21:21:54.021368 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.021152 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52" event={"ID":"f11e295a-6920-43d2-9531-4fecbd010fd2","Type":"ContainerStarted","Data":"3a57dbf1ee9c7269f61cb06fb7316dc6ccc88306689ee9646bd21433f336623b"} Jun 05 21:21:54.022996 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.022934 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p" event={"ID":"31a3db22-0f4e-4bcb-8401-489e216e1e43","Type":"ContainerStarted","Data":"96feda0823ce8f9bda7faff43a39fab8468552192f0a92f46dc4c87bbca3e960"} Jun 05 21:21:54.038876 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.038421 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-n6d52" podStartSLOduration=2.038400071 podStartE2EDuration="2.038400071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:21:54.037160397 +0000 UTC m=+199.105570296" watchObservedRunningTime="2026-06-05 21:21:54.038400071 +0000 UTC m=+199.106809972" Jun 05 21:21:54.208510 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.207649 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:21:54.208510 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.207823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:21:54.208510 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:54.207978 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:21:54.208510 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:54.208054 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls podName:58350d01-46ae-418a-94f5-d8a7641656ba nodeName:}" failed. No retries permitted until 2026-06-05 21:21:56.208033855 +0000 UTC m=+201.276443736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-z482x" (UID: "58350d01-46ae-418a-94f5-d8a7641656ba") : secret "samples-operator-tls" not found Jun 05 21:21:54.208510 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:54.208118 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:21:54.208510 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:54.208152 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert podName:982f450a-3056-4773-b6f4-a5f026cde0fb nodeName:}" failed. No retries permitted until 2026-06-05 21:21:56.208140893 +0000 UTC m=+201.276550778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5gnm7" (UID: "982f450a-3056-4773-b6f4-a5f026cde0fb") : secret "networking-console-plugin-cert" not found Jun 05 21:21:54.410408 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.410267 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:54.410408 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:54.410377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:54.410626 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:54.410437 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:21:54.410626 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:54.410497 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:21:56.410480056 +0000 UTC m=+201.478889937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : configmap references non-existent config key: service-ca.crt Jun 05 21:21:54.410626 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:54.410513 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:21:56.410505965 +0000 UTC m=+201.478915842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : secret "router-metrics-certs-default" not found Jun 05 21:21:55.028763 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:55.028715 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p" event={"ID":"31a3db22-0f4e-4bcb-8401-489e216e1e43","Type":"ContainerStarted","Data":"04c072816f265bedf71d82b31768491c0c1477848bf544afb0df035919aa32d2"} Jun 05 21:21:55.047068 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:55.047003 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-d6s9p" podStartSLOduration=1.734233899 podStartE2EDuration="3.046980608s" totalImagesPullingTime="1.312746709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:21:55.045820396 +0000 UTC m=+200.114230296" watchObservedRunningTime="2026-06-05 21:21:55.046980608 +0000 UTC m=+200.115390508" Jun 05 21:21:55.121757 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:55.121717 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:56.225856 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:56.225821 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:21:56.226311 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:56.225900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:21:56.226311 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:56.225994 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:21:56.226311 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:56.226002 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:21:56.226311 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:56.226051 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert podName:982f450a-3056-4773-b6f4-a5f026cde0fb nodeName:}" failed. No retries permitted until 2026-06-05 21:22:00.226038242 +0000 UTC m=+205.294448119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5gnm7" (UID: "982f450a-3056-4773-b6f4-a5f026cde0fb") : secret "networking-console-plugin-cert" not found Jun 05 21:21:56.226311 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:56.226069 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls podName:58350d01-46ae-418a-94f5-d8a7641656ba nodeName:}" failed. No retries permitted until 2026-06-05 21:22:00.226058345 +0000 UTC m=+205.294468222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-z482x" (UID: "58350d01-46ae-418a-94f5-d8a7641656ba") : secret "samples-operator-tls" not found Jun 05 21:21:56.427546 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:56.427514 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:56.427647 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:56.427623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:21:56.427722 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:56.427692 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:22:00.427674768 +0000 UTC m=+205.496084646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : configmap references non-existent config key: service-ca.crt Jun 05 21:21:56.427785 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:56.427752 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:21:56.427834 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:21:56.427800 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:22:00.42778889 +0000 UTC m=+205.496198770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : secret "router-metrics-certs-default" not found Jun 05 21:21:57.042282 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:57.042242 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" event={"ID":"06ad3e2f-8a4f-41ef-b298-45f6160a5946","Type":"ContainerStarted","Data":"94ba9113c639b5bc0cb17dbbb2785d4afa19b63beec32a1463d06a36e9b73ec3"} Jun 05 21:21:57.044072 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:57.044042 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" event={"ID":"998edffc-37fa-4c24-bc4b-38af52c4a3f3","Type":"ContainerStarted","Data":"325e4f242e67b2e779f5d3ebd63b1c4ff695dd78028e677b4fa314224f91348f"} Jun 05 21:21:57.045616 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:57.045587 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4dwkt" event={"ID":"d65a3ec8-23f8-4538-abb4-5c7b904b19fa","Type":"ContainerStarted","Data":"8a27a57767bf27bad7265404adf5a0d5f40b3912ac82833e417f54b705ed0c88"} Jun 05 21:21:57.058050 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:57.057999 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" podStartSLOduration=1.613336146 podStartE2EDuration="5.057982065s" totalImagesPullingTime="3.444645919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:21:57.057667262 +0000 UTC m=+202.126077162" watchObservedRunningTime="2026-06-05 21:21:57.057982065 +0000 UTC m=+202.126391966" Jun 05 21:21:57.074982 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:57.074930 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-4dwkt" podStartSLOduration=1.77519462 podStartE2EDuration="5.074910413s" totalImagesPullingTime="3.299715793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:21:57.074873799 +0000 UTC m=+202.143283699" watchObservedRunningTime="2026-06-05 21:21:57.074910413 +0000 UTC m=+202.143320313" Jun 05 21:21:57.090923 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:57.090865 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" podStartSLOduration=1.805807154 podStartE2EDuration="5.090849826s" totalImagesPullingTime="3.285042672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:21:57.089741752 +0000 UTC m=+202.158151652" watchObservedRunningTime="2026-06-05 21:21:57.090849826 +0000 UTC m=+202.159259727" Jun 05 21:21:57.831362 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:57.831310 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:57.885647 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:57.885616 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:58.122929 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:58.122842 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:58.220190 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:58.220155 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:58.320762 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:58.320734 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:58.656448 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:58.656413 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:58.935114 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:58.935035 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:59.035167 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:59.035130 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:59.921452 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:59.921418 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:59.976046 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:21:59.976021 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hlhxh_9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c/dns-node-resolver/0.log" Jun 05 21:22:00.021649 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:00.021617 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:00.261909 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:00.261869 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:22:00.262068 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:00.261979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:22:00.262068 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:00.262025 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:22:00.262068 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:00.262061 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:22:00.262165 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:00.262109 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert podName:982f450a-3056-4773-b6f4-a5f026cde0fb nodeName:}" failed. No retries permitted until 2026-06-05 21:22:08.262089674 +0000 UTC m=+213.330499559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5gnm7" (UID: "982f450a-3056-4773-b6f4-a5f026cde0fb") : secret "networking-console-plugin-cert" not found Jun 05 21:22:00.262165 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:00.262123 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls podName:58350d01-46ae-418a-94f5-d8a7641656ba nodeName:}" failed. No retries permitted until 2026-06-05 21:22:08.262117381 +0000 UTC m=+213.330527257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-z482x" (UID: "58350d01-46ae-418a-94f5-d8a7641656ba") : secret "samples-operator-tls" not found Jun 05 21:22:00.463464 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:00.463432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:00.463644 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:00.463533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:00.463644 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:00.463605 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:22:08.463581833 +0000 UTC m=+213.531991711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : configmap references non-existent config key: service-ca.crt Jun 05 21:22:00.463735 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:00.463656 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:22:00.463735 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:00.463704 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:22:08.463687855 +0000 UTC m=+213.532097739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : secret "router-metrics-certs-default" not found Jun 05 21:22:00.562952 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:00.562871 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:00.616610 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:00.616575 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:00.776581 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:00.776556 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-crm5k_5e0ece63-babe-4f8b-a960-33ea46fe7da7/node-ca/0.log" Jun 05 21:22:01.376391 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:01.376363 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c85sh_54379baf-13d5-418c-acea-be62ec48b079/serve-healthcheck-canary/0.log" Jun 05 21:22:01.398795 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:01.398765 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:04.315211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:04.315177 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:04.422129 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:04.422097 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:04.521906 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:04.521875 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:04.683215 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:04.683128 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:04.783498 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:04.783462 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:04.884626 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:04.884593 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:05.025473 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:05.025442 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:05.815890 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:05.815850 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:06.416732 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:06.416703 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:06.610381 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:06.610347 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:06.814099 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:06.814071 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:07.218605 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:07.218524 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:07.792287 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:07.792254 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:07.893170 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:07.893139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:08.223076 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.222988 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:08.286985 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.286956 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:08.330816 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.330781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:22:08.330966 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:08.330947 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 05 21:22:08.331025 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:08.331014 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert podName:982f450a-3056-4773-b6f4-a5f026cde0fb nodeName:}" failed. No retries permitted until 2026-06-05 21:22:24.33099859 +0000 UTC m=+229.399408467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5gnm7" (UID: "982f450a-3056-4773-b6f4-a5f026cde0fb") : secret "networking-console-plugin-cert" not found Jun 05 21:22:08.331025 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.330952 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:22:08.333316 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.333294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/58350d01-46ae-418a-94f5-d8a7641656ba-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-z482x\" (UID: \"58350d01-46ae-418a-94f5-d8a7641656ba\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:22:08.416308 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.416268 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:08.469530 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.469486 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" Jun 05 21:22:08.533226 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.533188 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:08.533504 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.533251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:08.533504 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:08.533489 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:22:08.533625 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:08.533507 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:22:24.533487066 +0000 UTC m=+229.601896957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : configmap references non-existent config key: service-ca.crt Jun 05 21:22:08.533625 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:08.533540 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs podName:1461e6c9-bae6-4d82-8c47-381a5c59537e nodeName:}" failed. No retries permitted until 2026-06-05 21:22:24.533527242 +0000 UTC m=+229.601937123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs") pod "router-default-6478957989-b8l59" (UID: "1461e6c9-bae6-4d82-8c47-381a5c59537e") : secret "router-metrics-certs-default" not found Jun 05 21:22:08.601736 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.601552 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x"] Jun 05 21:22:08.819507 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:08.819470 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:09.083805 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:09.083725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" event={"ID":"58350d01-46ae-418a-94f5-d8a7641656ba","Type":"ContainerStarted","Data":"503c8ebc7a0d619a0ec24880a1efdd7f945d7c8b5279f5f2187169efcc146832"} Jun 05 21:22:09.415746 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:09.415660 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:09.824093 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:09.824049 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:10.230190 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:10.230141 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:10.429975 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:10.429893 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:10.809543 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:10.809510 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:10.910193 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:10.910165 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:11.010365 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:11.010313 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:11.091841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:11.091755 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" event={"ID":"58350d01-46ae-418a-94f5-d8a7641656ba","Type":"ContainerStarted","Data":"b8a28af79ff423a576e45152442282529415a21a139c9bc6a999b82ff0eccc9f"} Jun 05 21:22:11.091841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:11.091805 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" event={"ID":"58350d01-46ae-418a-94f5-d8a7641656ba","Type":"ContainerStarted","Data":"0a7adf0aa06ca2e0c946a66a4b7160e62cf714b2e1d41da85d922c4d3fb2ca94"} Jun 05 21:22:11.108158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:11.108112 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-z482x" podStartSLOduration=17.659209767 podStartE2EDuration="19.108094668s" totalImagesPullingTime="1.448884901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:11.107255708 +0000 UTC m=+216.175665606" watchObservedRunningTime="2026-06-05 21:22:11.108094668 +0000 UTC m=+216.176504623" Jun 05 21:22:11.415396 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:11.415293 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:11.827000 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:11.826964 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:12.218250 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:12.218176 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:12.414055 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:12.414025 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:13.012025 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:13.011997 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:13.614953 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:13.614926 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:13.821106 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:13.821072 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:14.020945 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:14.020909 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:14.414530 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:14.414444 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:14.813520 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:14.813492 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:15.010235 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:15.010204 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:21.322550 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.322518 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6fbdm"] Jun 05 21:22:21.329094 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.329070 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.332905 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.332884 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 21:22:21.333047 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.332915 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 21:22:21.333047 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.332887 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w7t9j\"" Jun 05 21:22:21.339534 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.339511 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6fbdm"] Jun 05 21:22:21.342838 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.342818 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:21.434725 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.434694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14175f50-3032-472f-9b1b-911e7ec10dcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.434922 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.434731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14175f50-3032-472f-9b1b-911e7ec10dcd-crio-socket\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.434922 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.434768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chm4j\" (UniqueName: \"kubernetes.io/projected/14175f50-3032-472f-9b1b-911e7ec10dcd-kube-api-access-chm4j\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.434922 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.434788 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14175f50-3032-472f-9b1b-911e7ec10dcd-data-volume\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.434922 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.434822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14175f50-3032-472f-9b1b-911e7ec10dcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.535764 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.535733 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14175f50-3032-472f-9b1b-911e7ec10dcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.535764 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.535767 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14175f50-3032-472f-9b1b-911e7ec10dcd-crio-socket\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.535983 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.535800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chm4j\" (UniqueName: \"kubernetes.io/projected/14175f50-3032-472f-9b1b-911e7ec10dcd-kube-api-access-chm4j\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.535983 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.535821 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14175f50-3032-472f-9b1b-911e7ec10dcd-data-volume\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.535983 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.535853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14175f50-3032-472f-9b1b-911e7ec10dcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.535983 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.535902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14175f50-3032-472f-9b1b-911e7ec10dcd-crio-socket\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.536241 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.536222 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14175f50-3032-472f-9b1b-911e7ec10dcd-data-volume\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.536484 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.536465 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14175f50-3032-472f-9b1b-911e7ec10dcd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.538200 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.538172 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14175f50-3032-472f-9b1b-911e7ec10dcd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.544685 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.544662 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chm4j\" (UniqueName: \"kubernetes.io/projected/14175f50-3032-472f-9b1b-911e7ec10dcd-kube-api-access-chm4j\") pod \"insights-runtime-extractor-6fbdm\" (UID: \"14175f50-3032-472f-9b1b-911e7ec10dcd\") " pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.638545 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.638460 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6fbdm" Jun 05 21:22:21.765337 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:21.765300 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6fbdm"] Jun 05 21:22:21.767717 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:21.767693 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14175f50_3032_472f_9b1b_911e7ec10dcd.slice/crio-61f032828eb026eabc51dbe21287d51533e45f8f162c7303d7d92ae4c1b5469a WatchSource:0}: Error finding container 61f032828eb026eabc51dbe21287d51533e45f8f162c7303d7d92ae4c1b5469a: Status 404 returned error can't find the container with id 61f032828eb026eabc51dbe21287d51533e45f8f162c7303d7d92ae4c1b5469a Jun 05 21:22:22.128359 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:22.128314 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fbdm" event={"ID":"14175f50-3032-472f-9b1b-911e7ec10dcd","Type":"ContainerStarted","Data":"de1462c9f39650ab389dd3ba4ddda5156ffd58168ee454285b4f55c51c1316c3"} Jun 05 21:22:22.128509 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:22.128384 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fbdm" event={"ID":"14175f50-3032-472f-9b1b-911e7ec10dcd","Type":"ContainerStarted","Data":"61f032828eb026eabc51dbe21287d51533e45f8f162c7303d7d92ae4c1b5469a"} Jun 05 21:22:22.422117 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:22.422096 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:23.133317 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:23.133276 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fbdm" event={"ID":"14175f50-3032-472f-9b1b-911e7ec10dcd","Type":"ContainerStarted","Data":"6a8693ce3f1a4375e2dced80bff2c50449ebff1bff48a3cb7b51fffdf05a5c96"} Jun 05 21:22:24.138500 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.138424 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fbdm" event={"ID":"14175f50-3032-472f-9b1b-911e7ec10dcd","Type":"ContainerStarted","Data":"312173b4eb07ac5e855062c4d97438c843be3b1a2d0437aff7dc505f63debebf"} Jun 05 21:22:24.156321 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.156272 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6fbdm" podStartSLOduration=1.225291407 podStartE2EDuration="3.156253607s" totalImagesPullingTime="1.9309622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:22:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:24.154247339 +0000 UTC m=+229.222657240" watchObservedRunningTime="2026-06-05 21:22:24.156253607 +0000 UTC m=+229.224663505" Jun 05 21:22:24.360415 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.360379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:22:24.362735 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.362710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/982f450a-3056-4773-b6f4-a5f026cde0fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5gnm7\" (UID: \"982f450a-3056-4773-b6f4-a5f026cde0fb\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:22:24.375753 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.375718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" Jun 05 21:22:24.503741 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.503706 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7"] Jun 05 21:22:24.506430 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:24.506407 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982f450a_3056_4773_b6f4_a5f026cde0fb.slice/crio-5e826849fc94e684912aa6d6b0cc311daad95526d605018b152331c9d95caea8 WatchSource:0}: Error finding container 5e826849fc94e684912aa6d6b0cc311daad95526d605018b152331c9d95caea8: Status 404 returned error can't find the container with id 5e826849fc94e684912aa6d6b0cc311daad95526d605018b152331c9d95caea8 Jun 05 21:22:24.562786 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.562744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:24.562981 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.562807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:24.563406 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.563380 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1461e6c9-bae6-4d82-8c47-381a5c59537e-service-ca-bundle\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:24.565104 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.565086 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1461e6c9-bae6-4d82-8c47-381a5c59537e-metrics-certs\") pod \"router-default-6478957989-b8l59\" (UID: \"1461e6c9-bae6-4d82-8c47-381a5c59537e\") " pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:24.785689 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.785658 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:24.941989 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:24.941960 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6478957989-b8l59"] Jun 05 21:22:24.944358 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:24.944315 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1461e6c9_bae6_4d82_8c47_381a5c59537e.slice/crio-0ed1c18791e1a751adf0e852a6ae13fbe177a523e8f95f2131c9a7d25afc5fab WatchSource:0}: Error finding container 0ed1c18791e1a751adf0e852a6ae13fbe177a523e8f95f2131c9a7d25afc5fab: Status 404 returned error can't find the container with id 0ed1c18791e1a751adf0e852a6ae13fbe177a523e8f95f2131c9a7d25afc5fab Jun 05 21:22:25.143465 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:25.143428 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6478957989-b8l59" event={"ID":"1461e6c9-bae6-4d82-8c47-381a5c59537e","Type":"ContainerStarted","Data":"210a6ca5a5504b18721521fe5f59705a9b6f82c1bbb0ce26da32fc85ae9d6f8e"} Jun 05 21:22:25.143883 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:25.143478 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6478957989-b8l59" event={"ID":"1461e6c9-bae6-4d82-8c47-381a5c59537e","Type":"ContainerStarted","Data":"0ed1c18791e1a751adf0e852a6ae13fbe177a523e8f95f2131c9a7d25afc5fab"} Jun 05 21:22:25.144605 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:25.144576 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" event={"ID":"982f450a-3056-4773-b6f4-a5f026cde0fb","Type":"ContainerStarted","Data":"5e826849fc94e684912aa6d6b0cc311daad95526d605018b152331c9d95caea8"} Jun 05 21:22:25.162060 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:25.162007 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6478957989-b8l59" podStartSLOduration=33.161992001 podStartE2EDuration="33.161992001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:25.161115656 +0000 UTC m=+230.229525556" watchObservedRunningTime="2026-06-05 21:22:25.161992001 +0000 UTC m=+230.230401899" Jun 05 21:22:25.548249 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:25.548212 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:25.646835 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:25.646796 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:25.786718 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:25.786690 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:25.788833 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:25.788818 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:26.148300 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:26.148273 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:26.149448 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:26.149425 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6478957989-b8l59" Jun 05 21:22:27.151969 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.151928 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" event={"ID":"982f450a-3056-4773-b6f4-a5f026cde0fb","Type":"ContainerStarted","Data":"20f2392b7cbf8463bf652c1aca3bde3de4ea62170f2b49df30f4a17c39a33a01"} Jun 05 21:22:27.172597 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.172552 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5gnm7" podStartSLOduration=33.458625844 podStartE2EDuration="35.17253768s" totalImagesPullingTime="1.713911836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:27.171470171 +0000 UTC m=+232.239880067" watchObservedRunningTime="2026-06-05 21:22:27.17253768 +0000 UTC m=+232.240947578" Jun 05 21:22:27.305683 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.305644 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:27.402426 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.402271 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:27.491669 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.491618 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:27.492076 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.492055 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd"] Jun 05 21:22:27.494697 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.494682 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" Jun 05 21:22:27.497150 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.497127 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 05 21:22:27.497256 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.497164 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rzsvt\"" Jun 05 21:22:27.503132 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.503110 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd"] Jun 05 21:22:27.642705 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.642661 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:27.691421 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.691303 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/320074eb-8421-4f9e-bdd9-c816af12d956-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-s8bvd\" (UID: \"320074eb-8421-4f9e-bdd9-c816af12d956\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" Jun 05 21:22:27.792199 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.792153 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/320074eb-8421-4f9e-bdd9-c816af12d956-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-s8bvd\" (UID: \"320074eb-8421-4f9e-bdd9-c816af12d956\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" Jun 05 21:22:27.794595 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.794574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/320074eb-8421-4f9e-bdd9-c816af12d956-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-s8bvd\" (UID: \"320074eb-8421-4f9e-bdd9-c816af12d956\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" Jun 05 21:22:27.803461 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.803434 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" Jun 05 21:22:27.950038 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:27.950011 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd"] Jun 05 21:22:27.952504 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:27.952477 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320074eb_8421_4f9e_bdd9_c816af12d956.slice/crio-f2860ddbe627cfb66477e7dd462c8aacd63def247eb1035982be067a3153aec2 WatchSource:0}: Error finding container f2860ddbe627cfb66477e7dd462c8aacd63def247eb1035982be067a3153aec2: Status 404 returned error can't find the container with id f2860ddbe627cfb66477e7dd462c8aacd63def247eb1035982be067a3153aec2 Jun 05 21:22:28.156384 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:28.156351 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" event={"ID":"320074eb-8421-4f9e-bdd9-c816af12d956","Type":"ContainerStarted","Data":"f2860ddbe627cfb66477e7dd462c8aacd63def247eb1035982be067a3153aec2"} Jun 05 21:22:29.161062 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.161026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" event={"ID":"320074eb-8421-4f9e-bdd9-c816af12d956","Type":"ContainerStarted","Data":"afb86e7976c3a3b00c4031d07e20e674c9238127473fbad172fa1f463c85c9e7"} Jun 05 21:22:29.161606 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.161238 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" Jun 05 21:22:29.165853 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.165831 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" Jun 05 21:22:29.176548 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.176506 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-s8bvd" podStartSLOduration=1.146679355 podStartE2EDuration="2.176492568s" totalImagesPullingTime="1.029813213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:29.175215048 +0000 UTC m=+234.243624947" watchObservedRunningTime="2026-06-05 21:22:29.176492568 +0000 UTC m=+234.244902466" Jun 05 21:22:29.514086 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.514051 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:29.554034 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.554002 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj"] Jun 05 21:22:29.557211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.557195 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.559867 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.559840 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 21:22:29.560015 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.559840 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 21:22:29.560015 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.559844 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 21:22:29.561006 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.560959 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 21:22:29.561121 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.561106 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 21:22:29.561192 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.561177 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-df6vn\"" Jun 05 21:22:29.566200 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.566180 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj"] Jun 05 21:22:29.583559 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.583533 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:29.605696 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.605667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/329060e6-4142-4ad6-b905-a05f9b8455f9-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.605835 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.605728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/329060e6-4142-4ad6-b905-a05f9b8455f9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.605835 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.605805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/329060e6-4142-4ad6-b905-a05f9b8455f9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.605947 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.605836 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6r82\" (UniqueName: \"kubernetes.io/projected/329060e6-4142-4ad6-b905-a05f9b8455f9-kube-api-access-m6r82\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.706471 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.706440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/329060e6-4142-4ad6-b905-a05f9b8455f9-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.706622 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.706493 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/329060e6-4142-4ad6-b905-a05f9b8455f9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.706622 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.706543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/329060e6-4142-4ad6-b905-a05f9b8455f9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.706622 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.706567 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6r82\" (UniqueName: \"kubernetes.io/projected/329060e6-4142-4ad6-b905-a05f9b8455f9-kube-api-access-m6r82\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.706622 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:29.706584 2567 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 05 21:22:29.706848 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:29.706649 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329060e6-4142-4ad6-b905-a05f9b8455f9-prometheus-operator-tls podName:329060e6-4142-4ad6-b905-a05f9b8455f9 nodeName:}" failed. No retries permitted until 2026-06-05 21:22:30.20663258 +0000 UTC m=+235.275042457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/329060e6-4142-4ad6-b905-a05f9b8455f9-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-nbvvj" (UID: "329060e6-4142-4ad6-b905-a05f9b8455f9") : secret "prometheus-operator-tls" not found Jun 05 21:22:29.707175 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.707153 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/329060e6-4142-4ad6-b905-a05f9b8455f9-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.708874 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.708857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/329060e6-4142-4ad6-b905-a05f9b8455f9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.717505 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.717479 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6r82\" (UniqueName: \"kubernetes.io/projected/329060e6-4142-4ad6-b905-a05f9b8455f9-kube-api-access-m6r82\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:29.840739 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:29.840643 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:30.209659 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:30.209570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/329060e6-4142-4ad6-b905-a05f9b8455f9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:30.211965 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:30.211939 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/329060e6-4142-4ad6-b905-a05f9b8455f9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nbvvj\" (UID: \"329060e6-4142-4ad6-b905-a05f9b8455f9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:30.466188 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:30.466101 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" Jun 05 21:22:30.592561 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:30.592506 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj"] Jun 05 21:22:30.595076 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:30.595054 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329060e6_4142_4ad6_b905_a05f9b8455f9.slice/crio-e65969c5b2ab3e45c6829599f7f2b50350b1405a7fc2fc231832fcaf96cbcc25 WatchSource:0}: Error finding container e65969c5b2ab3e45c6829599f7f2b50350b1405a7fc2fc231832fcaf96cbcc25: Status 404 returned error can't find the container with id e65969c5b2ab3e45c6829599f7f2b50350b1405a7fc2fc231832fcaf96cbcc25 Jun 05 21:22:31.169111 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:31.169076 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" event={"ID":"329060e6-4142-4ad6-b905-a05f9b8455f9","Type":"ContainerStarted","Data":"e65969c5b2ab3e45c6829599f7f2b50350b1405a7fc2fc231832fcaf96cbcc25"} Jun 05 21:22:32.180557 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:32.180508 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" event={"ID":"329060e6-4142-4ad6-b905-a05f9b8455f9","Type":"ContainerStarted","Data":"c5d6af6f52156124fc400c18c2c1d114326753fa415375a997dc23aa71a330b6"} Jun 05 21:22:32.352676 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:32.352592 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:33.185839 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:33.185805 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" event={"ID":"329060e6-4142-4ad6-b905-a05f9b8455f9","Type":"ContainerStarted","Data":"70835e28c6bc028c771dd1ab05fd6d914c2a72d2c12fc58d84c598ffc348063e"} Jun 05 21:22:33.203419 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:33.203358 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nbvvj" podStartSLOduration=2.726441529 podStartE2EDuration="4.203342605s" totalImagesPullingTime="1.476901076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:33.202451541 +0000 UTC m=+238.270861441" watchObservedRunningTime="2026-06-05 21:22:33.203342605 +0000 UTC m=+238.271752495" Jun 05 21:22:34.657671 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.657641 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:34.870027 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.869990 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:34.888604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.888564 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d"] Jun 05 21:22:34.891888 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.891866 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:34.894360 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.894315 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 21:22:34.894484 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.894345 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 21:22:34.894484 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.894371 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-z729c\"" Jun 05 21:22:34.903132 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.903110 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d"] Jun 05 21:22:34.908431 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.908368 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s4gs5"] Jun 05 21:22:34.911591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.911572 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.912143 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.912124 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2"] Jun 05 21:22:34.913977 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.913956 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 21:22:34.914086 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.913999 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wpcm7\"" Jun 05 21:22:34.914086 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.914040 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 21:22:34.914086 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.913960 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 21:22:34.915562 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.915548 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:34.917596 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.917578 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 21:22:34.918063 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.918041 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2p2t2\"" Jun 05 21:22:34.918063 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.918058 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 21:22:34.918201 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.918104 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 21:22:34.926944 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.926920 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2"] Jun 05 21:22:34.941317 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2738009-456e-424b-a0ec-c789639b0bb9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:34.941473 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.941473 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941363 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:34.941473 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941425 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:34.941473 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb79e112-08ca-4c27-82e2-f50031120210-root\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.941624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2738009-456e-424b-a0ec-c789639b0bb9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:34.941624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-tls\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.941624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941520 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq27b\" (UniqueName: \"kubernetes.io/projected/b2738009-456e-424b-a0ec-c789639b0bb9-kube-api-access-vq27b\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:34.941624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941566 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb79e112-08ca-4c27-82e2-f50031120210-metrics-client-ca\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.941624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-wtmp\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.941624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941612 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2738009-456e-424b-a0ec-c789639b0bb9-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:34.941841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941649 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:34.941841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.941841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941697 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:34.941841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941722 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-textfile\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.941841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv452\" (UniqueName: \"kubernetes.io/projected/fb79e112-08ca-4c27-82e2-f50031120210-kube-api-access-rv452\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.942047 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941843 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb79e112-08ca-4c27-82e2-f50031120210-sys\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:34.942047 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941887 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:34.942047 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.941916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqv2w\" (UniqueName: \"kubernetes.io/projected/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-api-access-pqv2w\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:34.964377 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:34.964301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:35.042722 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.042683 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.042722 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.042716 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.042962 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.042739 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.042962 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.042797 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb79e112-08ca-4c27-82e2-f50031120210-root\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.042962 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.042829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2738009-456e-424b-a0ec-c789639b0bb9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:35.042962 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:35.042852 2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 05 21:22:35.042962 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.042861 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb79e112-08ca-4c27-82e2-f50031120210-root\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.042962 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.042857 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-tls\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.042962 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:35.042911 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-tls podName:8b9b7012-5b30-47b7-8580-f0bd30d6b5d3 nodeName:}" failed. No retries permitted until 2026-06-05 21:22:35.54289387 +0000 UTC m=+240.611303752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-jjzv2" (UID: "8b9b7012-5b30-47b7-8580-f0bd30d6b5d3") : secret "kube-state-metrics-tls" not found Jun 05 21:22:35.043275 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.042979 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq27b\" (UniqueName: \"kubernetes.io/projected/b2738009-456e-424b-a0ec-c789639b0bb9-kube-api-access-vq27b\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:35.043275 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb79e112-08ca-4c27-82e2-f50031120210-metrics-client-ca\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.043275 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043059 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-wtmp\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.043275 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043088 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2738009-456e-424b-a0ec-c789639b0bb9-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:35.043275 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043119 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.043275 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043213 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.043572 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043412 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-accelerators-collector-config\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.043572 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043551 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-wtmp\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.043685 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043660 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb79e112-08ca-4c27-82e2-f50031120210-metrics-client-ca\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.043745 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043765 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043919 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-textfile\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043945 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv452\" (UniqueName: \"kubernetes.io/projected/fb79e112-08ca-4c27-82e2-f50031120210-kube-api-access-rv452\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.043970 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2738009-456e-424b-a0ec-c789639b0bb9-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.044002 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb79e112-08ca-4c27-82e2-f50031120210-sys\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.044039 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.044062 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.044074 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.044069 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqv2w\" (UniqueName: \"kubernetes.io/projected/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-api-access-pqv2w\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.044174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.044124 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb79e112-08ca-4c27-82e2-f50031120210-sys\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.044925 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.044195 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-textfile\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.044925 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.044200 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2738009-456e-424b-a0ec-c789639b0bb9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:35.044925 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.044808 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.045971 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.045948 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-tls\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.046235 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.046211 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb79e112-08ca-4c27-82e2-f50031120210-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.046313 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.046295 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2738009-456e-424b-a0ec-c789639b0bb9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:35.046415 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.046398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.046606 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.046588 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2738009-456e-424b-a0ec-c789639b0bb9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:35.056144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.056097 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq27b\" (UniqueName: \"kubernetes.io/projected/b2738009-456e-424b-a0ec-c789639b0bb9-kube-api-access-vq27b\") pod \"openshift-state-metrics-65f78d5c66-8qd2d\" (UID: \"b2738009-456e-424b-a0ec-c789639b0bb9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:35.056269 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.056241 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqv2w\" (UniqueName: \"kubernetes.io/projected/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-api-access-pqv2w\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.056269 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.056247 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv452\" (UniqueName: \"kubernetes.io/projected/fb79e112-08ca-4c27-82e2-f50031120210-kube-api-access-rv452\") pod \"node-exporter-s4gs5\" (UID: \"fb79e112-08ca-4c27-82e2-f50031120210\") " pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.143991 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.143957 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:35.201167 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.201084 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" Jun 05 21:22:35.201447 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.201425 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:35.222295 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.222269 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s4gs5" Jun 05 21:22:35.232876 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:35.232849 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb79e112_08ca_4c27_82e2_f50031120210.slice/crio-5ee3c09837a5309060f5b4e73a8879fcd4b57648b62789c049ac5f6cecf79658 WatchSource:0}: Error finding container 5ee3c09837a5309060f5b4e73a8879fcd4b57648b62789c049ac5f6cecf79658: Status 404 returned error can't find the container with id 5ee3c09837a5309060f5b4e73a8879fcd4b57648b62789c049ac5f6cecf79658 Jun 05 21:22:35.329083 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.329061 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d"] Jun 05 21:22:35.330841 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:35.330820 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2738009_456e_424b_a0ec_c789639b0bb9.slice/crio-1874d6a1bd1cb3b73cda89be4df584133d535f993881a2db8487c28d1b7a9377 WatchSource:0}: Error finding container 1874d6a1bd1cb3b73cda89be4df584133d535f993881a2db8487c28d1b7a9377: Status 404 returned error can't find the container with id 1874d6a1bd1cb3b73cda89be4df584133d535f993881a2db8487c28d1b7a9377 Jun 05 21:22:35.549422 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.549377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:35.549643 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:35.549555 2567 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 05 21:22:35.549643 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:35.549636 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-tls podName:8b9b7012-5b30-47b7-8580-f0bd30d6b5d3 nodeName:}" failed. No retries permitted until 2026-06-05 21:22:36.549615617 +0000 UTC m=+241.618025507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-jjzv2" (UID: "8b9b7012-5b30-47b7-8580-f0bd30d6b5d3") : secret "kube-state-metrics-tls" not found Jun 05 21:22:35.720775 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.720696 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:35.899429 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.899394 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:35.977086 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.977006 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:35.981649 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.981618 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:22:35.986323 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.986298 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:35.988994 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.988968 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qwq6j\"" Jun 05 21:22:35.989147 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.989004 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 21:22:35.989279 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.989253 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 21:22:35.989407 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.989284 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 21:22:35.989407 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.989379 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 21:22:35.989407 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.989398 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 21:22:35.989668 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.989415 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 21:22:35.989668 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.989468 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 21:22:35.989668 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.989619 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 21:22:35.989817 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:35.989746 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 21:22:36.000754 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.000726 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:22:36.054347 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054506 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054362 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054506 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054506 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-web-config\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054506 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054461 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054506 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054484 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-out\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxlks\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-kube-api-access-wxlks\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-volume\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.054776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.054731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.100887 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.100848 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:36.155716 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.155684 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.155875 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.155722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-web-config\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.155875 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.155755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.155875 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.155779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156007 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.155895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156007 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.155950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-out\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156104 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.156001 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxlks\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-kube-api-access-wxlks\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156104 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.156063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-volume\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156104 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.156090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156249 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.156121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156249 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.156157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156249 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.156223 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156472 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.156251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.156645 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.156623 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.157491 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:36.157181 2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 05 21:22:36.157491 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:22:36.157254 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-main-tls podName:97d891fa-8acc-463d-ad5c-351f82d52ffa nodeName:}" failed. No retries permitted until 2026-06-05 21:22:36.65723246 +0000 UTC m=+241.725642353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa") : secret "alertmanager-main-tls" not found Jun 05 21:22:36.157984 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.157958 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.158131 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.158106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.159758 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.159279 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-out\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.159758 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.159558 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-web-config\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.159758 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.159691 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.159758 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.159716 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-volume\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.160176 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.160155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.160297 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.160280 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.160377 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.160291 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.160874 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.160851 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.166837 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.166812 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxlks\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-kube-api-access-wxlks\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.198263 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.198224 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4gs5" event={"ID":"fb79e112-08ca-4c27-82e2-f50031120210","Type":"ContainerStarted","Data":"5ee3c09837a5309060f5b4e73a8879fcd4b57648b62789c049ac5f6cecf79658"} Jun 05 21:22:36.200402 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.200363 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" event={"ID":"b2738009-456e-424b-a0ec-c789639b0bb9","Type":"ContainerStarted","Data":"5f775a6c15db93e6726e008d5e282f4e93e0c24693d749393bf22b628c2bac23"} Jun 05 21:22:36.200537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.200428 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" event={"ID":"b2738009-456e-424b-a0ec-c789639b0bb9","Type":"ContainerStarted","Data":"c369efb582effbb31633f5ade03cfdbc148dffaf8451372cc2490863eea85795"} Jun 05 21:22:36.200537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.200452 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" event={"ID":"b2738009-456e-424b-a0ec-c789639b0bb9","Type":"ContainerStarted","Data":"1874d6a1bd1cb3b73cda89be4df584133d535f993881a2db8487c28d1b7a9377"} Jun 05 21:22:36.559882 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.559840 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:36.562185 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.562159 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9b7012-5b30-47b7-8580-f0bd30d6b5d3-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-jjzv2\" (UID: \"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:36.630543 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.630515 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:36.660534 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.660497 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.662864 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.662838 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:36.730457 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.730374 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2p2t2\"" Jun 05 21:22:36.738459 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.738434 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" Jun 05 21:22:36.869856 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.869237 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2"] Jun 05 21:22:36.899675 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:36.899638 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:22:37.038109 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.038086 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:22:37.039529 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:37.039505 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d891fa_8acc_463d_ad5c_351f82d52ffa.slice/crio-e967ab068a0380a85254223a3c4690dc72866a8e6810d4256b76c752a79ab624 WatchSource:0}: Error finding container e967ab068a0380a85254223a3c4690dc72866a8e6810d4256b76c752a79ab624: Status 404 returned error can't find the container with id e967ab068a0380a85254223a3c4690dc72866a8e6810d4256b76c752a79ab624 Jun 05 21:22:37.205779 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.205743 2567 generic.go:356] "Generic (PLEG): container finished" podID="fb79e112-08ca-4c27-82e2-f50031120210" containerID="cdf4e126300c1ecddc374567b1fdbec9ceefe57a78c82fa1a06660f38f2ca0cb" exitCode=0 Jun 05 21:22:37.205949 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.205830 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4gs5" event={"ID":"fb79e112-08ca-4c27-82e2-f50031120210","Type":"ContainerDied","Data":"cdf4e126300c1ecddc374567b1fdbec9ceefe57a78c82fa1a06660f38f2ca0cb"} Jun 05 21:22:37.207065 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.207047 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" event={"ID":"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3","Type":"ContainerStarted","Data":"276207af399db20e25ab0fb3eabf341df10d65df0eda2d33cfdd97ff2b69504b"} Jun 05 21:22:37.208216 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.208192 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerStarted","Data":"e967ab068a0380a85254223a3c4690dc72866a8e6810d4256b76c752a79ab624"} Jun 05 21:22:37.210504 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.210480 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" event={"ID":"b2738009-456e-424b-a0ec-c789639b0bb9","Type":"ContainerStarted","Data":"732ba63baa6cee54b21657a700ce36aad97bb0c6ec62d4236f55ec6f64c29881"} Jun 05 21:22:37.241306 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.241253 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8qd2d" podStartSLOduration=2.288010497 podStartE2EDuration="3.241235436s" totalImagesPullingTime="953.224939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:37.239992076 +0000 UTC m=+242.308401975" watchObservedRunningTime="2026-06-05 21:22:37.241235436 +0000 UTC m=+242.309645373" Jun 05 21:22:37.828049 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.828012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:37.929122 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.929089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:37.985584 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:37.985367 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:38.218059 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:38.217974 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4gs5" event={"ID":"fb79e112-08ca-4c27-82e2-f50031120210","Type":"ContainerStarted","Data":"43284bd6f34ac59e685131aa42410cc01be8aba61fb219b835ef0e003b1648a6"} Jun 05 21:22:38.218059 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:38.218044 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s4gs5" event={"ID":"fb79e112-08ca-4c27-82e2-f50031120210","Type":"ContainerStarted","Data":"470c37200834fb8f108f2e097caf19c577325791f28054507ba924736f61df33"} Jun 05 21:22:38.254290 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:38.254238 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s4gs5" podStartSLOduration=2.993450704 podStartE2EDuration="4.254216027s" totalImagesPullingTime="1.189041224s" totalInitContainerRuntime="71.724099ms" isStatefulPod=true podCreationTimestamp="2026-06-05 21:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:38.252925214 +0000 UTC m=+243.321335114" watchObservedRunningTime="2026-06-05 21:22:38.254216027 +0000 UTC m=+243.322625926" Jun 05 21:22:38.302791 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:38.302755 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:38.354000 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:38.353977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:38.455820 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:38.455788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:38.556352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:38.556303 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:38.656147 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:38.656113 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:38.920489 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:38.920453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:39.021518 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.021487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:39.120942 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.120915 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:39.223574 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.223495 2567 generic.go:356] "Generic (PLEG): container finished" podID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerID="ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a" exitCode=0 Jun 05 21:22:39.223749 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.223578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerDied","Data":"ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a"} Jun 05 21:22:39.227939 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.227901 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" event={"ID":"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3","Type":"ContainerStarted","Data":"6f8666593f5f2724d0c9f1f17adfe9d1a9bcf9522465cbb71e0c2982d32a27f3"} Jun 05 21:22:39.228056 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.227958 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" event={"ID":"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3","Type":"ContainerStarted","Data":"e3706c43ac1e6466a50ec4b276038ba18c891def9ac78aa9108c180300afe792"} Jun 05 21:22:39.228056 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.227982 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" event={"ID":"8b9b7012-5b30-47b7-8580-f0bd30d6b5d3","Type":"ContainerStarted","Data":"8f450a06335cc8363cf582a2a628f543cf0768b6e0c202a399c4078bde505ae7"} Jun 05 21:22:39.334303 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.334247 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-jjzv2" podStartSLOduration=3.88576738 podStartE2EDuration="5.334229956s" totalImagesPullingTime="1.448462576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:39.333423253 +0000 UTC m=+244.401833153" watchObservedRunningTime="2026-06-05 21:22:39.334229956 +0000 UTC m=+244.402639855" Jun 05 21:22:39.380278 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.380228 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:39.481503 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.481427 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:39.672415 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.672381 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:39.749511 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.749481 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:39.808519 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.808480 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:39.931937 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:39.931904 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:40.651876 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:40.651845 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:41.101043 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:41.101011 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:41.182131 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:41.182051 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:41.239675 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:41.239617 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerStarted","Data":"86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a"} Jun 05 21:22:41.239852 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:41.239698 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerStarted","Data":"381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d"} Jun 05 21:22:41.239852 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:41.239739 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerStarted","Data":"561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932"} Jun 05 21:22:41.239852 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:41.239782 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerStarted","Data":"8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8"} Jun 05 21:22:41.239852 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:41.239820 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerStarted","Data":"f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952"} Jun 05 21:22:41.382274 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:41.382237 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:41.437696 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:41.437615 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:42.246122 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:42.246089 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerStarted","Data":"0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402"} Jun 05 21:22:42.277680 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:42.277629 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.830615852 podStartE2EDuration="7.277613203s" totalImagesPullingTime="3.427342705s" totalInitContainerRuntime="19.654646ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:42.274993587 +0000 UTC m=+247.343403486" watchObservedRunningTime="2026-06-05 21:22:42.277613203 +0000 UTC m=+247.346023177" Jun 05 21:22:47.263583 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.263544 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:22:47.266064 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.266031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa53bf6c-8b56-457a-9ccd-ccd794dc48a8-metrics-certs\") pod \"network-metrics-daemon-fpmnj\" (UID: \"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8\") " pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:22:47.435022 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.434995 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6kmjr\"" Jun 05 21:22:47.443253 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.443228 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpmnj" Jun 05 21:22:47.562319 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.562289 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57b4bdcf48-59scc"] Jun 05 21:22:47.568677 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.568645 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.571354 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.571316 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 21:22:47.571476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.571352 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 21:22:47.571476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.571357 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 21:22:47.571476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.571395 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hbt8c\"" Jun 05 21:22:47.571476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.571316 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 21:22:47.571663 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.571397 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 21:22:47.573197 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.572938 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 21:22:47.573197 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.572950 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 21:22:47.574455 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.574435 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fpmnj"] Jun 05 21:22:47.577365 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.577023 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b4bdcf48-59scc"] Jun 05 21:22:47.578268 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:47.578246 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa53bf6c_8b56_457a_9ccd_ccd794dc48a8.slice/crio-127251631e85f396d14e29c1309153a0bb5b953b206b45bcd36b85da859f32ef WatchSource:0}: Error finding container 127251631e85f396d14e29c1309153a0bb5b953b206b45bcd36b85da859f32ef: Status 404 returned error can't find the container with id 127251631e85f396d14e29c1309153a0bb5b953b206b45bcd36b85da859f32ef Jun 05 21:22:47.669918 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.669872 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-oauth-config\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.670097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.669927 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-config\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.670097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.669958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-oauth-serving-cert\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.670097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.670020 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-serving-cert\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.670097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.670068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-service-ca\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.670097 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.670089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwdm\" (UniqueName: \"kubernetes.io/projected/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-kube-api-access-ppwdm\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.770799 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.770757 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-oauth-config\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.770799 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.770804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-config\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.771018 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.770828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-oauth-serving-cert\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.771018 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.770968 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-serving-cert\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.771092 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.771023 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-service-ca\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.771092 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.771052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwdm\" (UniqueName: \"kubernetes.io/projected/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-kube-api-access-ppwdm\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.771711 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.771687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-config\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.771837 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.771687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-oauth-serving-cert\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.771837 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.771793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-service-ca\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.773547 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.773525 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-oauth-config\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.773547 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.773537 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-serving-cert\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.778954 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.778899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwdm\" (UniqueName: \"kubernetes.io/projected/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-kube-api-access-ppwdm\") pod \"console-57b4bdcf48-59scc\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:47.887354 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:47.887302 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:48.035387 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:48.035358 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b4bdcf48-59scc"] Jun 05 21:22:48.038141 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:22:48.038108 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf70518f_5899_4e8a_9b6e_e5f6b3d3ab3a.slice/crio-9c0793e0cff5e8cabb806f106a6fb285277299835ff956e93b4ad5466dfc82cf WatchSource:0}: Error finding container 9c0793e0cff5e8cabb806f106a6fb285277299835ff956e93b4ad5466dfc82cf: Status 404 returned error can't find the container with id 9c0793e0cff5e8cabb806f106a6fb285277299835ff956e93b4ad5466dfc82cf Jun 05 21:22:48.278677 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:48.278620 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b4bdcf48-59scc" event={"ID":"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a","Type":"ContainerStarted","Data":"9c0793e0cff5e8cabb806f106a6fb285277299835ff956e93b4ad5466dfc82cf"} Jun 05 21:22:48.280166 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:48.280086 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fpmnj" event={"ID":"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8","Type":"ContainerStarted","Data":"127251631e85f396d14e29c1309153a0bb5b953b206b45bcd36b85da859f32ef"} Jun 05 21:22:49.286315 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:49.286275 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fpmnj" event={"ID":"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8","Type":"ContainerStarted","Data":"7753f069d88412a45297bbc273729efa4224add0f468f94be7df56f7bc5d21e4"} Jun 05 21:22:49.286815 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:49.286355 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fpmnj" event={"ID":"aa53bf6c-8b56-457a-9ccd-ccd794dc48a8","Type":"ContainerStarted","Data":"fecee2a5fcc80ea22b56cbe64e8f40394bbfcbb4c242a2e142c2389aa97fda55"} Jun 05 21:22:49.304123 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:49.304074 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fpmnj" podStartSLOduration=253.305492501 podStartE2EDuration="4m14.304055495s" totalImagesPullingTime="998.562994ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:49.301683644 +0000 UTC m=+254.370093544" watchObservedRunningTime="2026-06-05 21:22:49.304055495 +0000 UTC m=+254.372465372" Jun 05 21:22:49.387987 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:49.387945 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:49.440383 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:49.440352 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:52.300286 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:52.300247 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b4bdcf48-59scc" event={"ID":"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a","Type":"ContainerStarted","Data":"6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070"} Jun 05 21:22:52.318400 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:52.318347 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57b4bdcf48-59scc" podStartSLOduration=1.8402621080000001 podStartE2EDuration="5.318317039s" totalImagesPullingTime="3.478054931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:22:52.316667854 +0000 UTC m=+257.385077754" watchObservedRunningTime="2026-06-05 21:22:52.318317039 +0000 UTC m=+257.386726937" Jun 05 21:22:53.949372 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:53.949316 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:54.050114 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:54.050082 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:56.108417 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:56.108379 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:56.162102 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:56.162067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:57.552126 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:57.552091 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:57.599304 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:57.599276 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:57.887590 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:57.887494 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:57.887590 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:57.887569 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:22:57.888854 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:57.888827 2567 patch_prober.go:28] interesting pod/console-57b4bdcf48-59scc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 05 21:22:57.888997 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:57.888891 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-57b4bdcf48-59scc" podUID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 05 21:22:58.179179 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:58.179094 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:58.232059 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:58.232023 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:22:59.357755 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:22:59.357721 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:01.011312 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:01.011281 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:01.065110 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:01.065080 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:02.683941 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:02.683907 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:07.888163 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:07.888124 2567 patch_prober.go:28] interesting pod/console-57b4bdcf48-59scc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 05 21:23:07.888579 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:07.888180 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-57b4bdcf48-59scc" podUID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 05 21:23:08.362298 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:08.362265 2567 generic.go:356] "Generic (PLEG): container finished" podID="d65a3ec8-23f8-4538-abb4-5c7b904b19fa" containerID="8a27a57767bf27bad7265404adf5a0d5f40b3912ac82833e417f54b705ed0c88" exitCode=0 Jun 05 21:23:08.362298 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:08.362302 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4dwkt" event={"ID":"d65a3ec8-23f8-4538-abb4-5c7b904b19fa","Type":"ContainerDied","Data":"8a27a57767bf27bad7265404adf5a0d5f40b3912ac82833e417f54b705ed0c88"} Jun 05 21:23:08.362668 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:08.362653 2567 scope.go:117] "RemoveContainer" containerID="8a27a57767bf27bad7265404adf5a0d5f40b3912ac82833e417f54b705ed0c88" Jun 05 21:23:09.368042 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:09.368007 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-4dwkt" event={"ID":"d65a3ec8-23f8-4538-abb4-5c7b904b19fa","Type":"ContainerStarted","Data":"bd2c9e3835be2bf889d08d94a7b5b5174677e84f9a0f253d348279d3a7a2e78c"} Jun 05 21:23:09.951089 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:09.951055 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:10.005549 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:10.005516 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:11.426349 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:11.426300 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_97d891fa-8acc-463d-ad5c-351f82d52ffa/init-config-reloader/0.log" Jun 05 21:23:11.625623 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:11.625599 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_97d891fa-8acc-463d-ad5c-351f82d52ffa/alertmanager/0.log" Jun 05 21:23:11.827411 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:11.827383 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_97d891fa-8acc-463d-ad5c-351f82d52ffa/config-reloader/0.log" Jun 05 21:23:12.026314 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:12.026285 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_97d891fa-8acc-463d-ad5c-351f82d52ffa/kube-rbac-proxy-web/0.log" Jun 05 21:23:12.226557 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:12.226462 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_97d891fa-8acc-463d-ad5c-351f82d52ffa/kube-rbac-proxy/0.log" Jun 05 21:23:12.425781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:12.425753 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_97d891fa-8acc-463d-ad5c-351f82d52ffa/kube-rbac-proxy-metric/0.log" Jun 05 21:23:12.628317 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:12.628289 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_97d891fa-8acc-463d-ad5c-351f82d52ffa/prom-label-proxy/0.log" Jun 05 21:23:13.027397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:13.027365 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-jjzv2_8b9b7012-5b30-47b7-8580-f0bd30d6b5d3/kube-state-metrics/0.log" Jun 05 21:23:13.226517 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:13.226471 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-jjzv2_8b9b7012-5b30-47b7-8580-f0bd30d6b5d3/kube-rbac-proxy-main/0.log" Jun 05 21:23:13.385012 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:13.384929 2567 generic.go:356] "Generic (PLEG): container finished" podID="06ad3e2f-8a4f-41ef-b298-45f6160a5946" containerID="94ba9113c639b5bc0cb17dbbb2785d4afa19b63beec32a1463d06a36e9b73ec3" exitCode=0 Jun 05 21:23:13.385012 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:13.385000 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" event={"ID":"06ad3e2f-8a4f-41ef-b298-45f6160a5946","Type":"ContainerDied","Data":"94ba9113c639b5bc0cb17dbbb2785d4afa19b63beec32a1463d06a36e9b73ec3"} Jun 05 21:23:13.385386 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:13.385370 2567 scope.go:117] "RemoveContainer" containerID="94ba9113c639b5bc0cb17dbbb2785d4afa19b63beec32a1463d06a36e9b73ec3" Jun 05 21:23:13.426663 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:13.426636 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-jjzv2_8b9b7012-5b30-47b7-8580-f0bd30d6b5d3/kube-rbac-proxy-self/0.log" Jun 05 21:23:14.390248 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:14.390210 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfcjq" event={"ID":"06ad3e2f-8a4f-41ef-b298-45f6160a5946","Type":"ContainerStarted","Data":"9f21e3591b8057d5dfa946e975a529cdc3cd819d275c3630b144e3c2291e5074"} Jun 05 21:23:15.226195 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:15.226170 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4gs5_fb79e112-08ca-4c27-82e2-f50031120210/init-textfile/0.log" Jun 05 21:23:15.427275 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:15.427250 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4gs5_fb79e112-08ca-4c27-82e2-f50031120210/node-exporter/0.log" Jun 05 21:23:15.625826 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:15.625795 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4gs5_fb79e112-08ca-4c27-82e2-f50031120210/kube-rbac-proxy/0.log" Jun 05 21:23:15.826127 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:15.826098 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8qd2d_b2738009-456e-424b-a0ec-c789639b0bb9/kube-rbac-proxy-main/0.log" Jun 05 21:23:15.911849 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:23:15.911756 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qvw5m" podUID="ebede3cb-2f3e-4d4b-83ae-909de1f9e78b" Jun 05 21:23:15.911849 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:23:15.911780 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" podUID="87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" Jun 05 21:23:16.026542 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:16.026511 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8qd2d_b2738009-456e-424b-a0ec-c789639b0bb9/kube-rbac-proxy-self/0.log" Jun 05 21:23:16.226623 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:16.226544 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8qd2d_b2738009-456e-424b-a0ec-c789639b0bb9/openshift-state-metrics/0.log" Jun 05 21:23:16.397748 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:16.397721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:23:16.397916 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:16.397721 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvw5m" Jun 05 21:23:17.828381 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:17.828351 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-nbvvj_329060e6-4142-4ad6-b905-a05f9b8455f9/prometheus-operator/0.log" Jun 05 21:23:17.888248 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:17.888212 2567 patch_prober.go:28] interesting pod/console-57b4bdcf48-59scc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 05 21:23:17.888434 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:17.888266 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-57b4bdcf48-59scc" podUID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 05 21:23:18.026600 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:18.026566 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-nbvvj_329060e6-4142-4ad6-b905-a05f9b8455f9/kube-rbac-proxy/0.log" Jun 05 21:23:18.226947 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:18.226865 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-s8bvd_320074eb-8421-4f9e-bdd9-c816af12d956/prometheus-operator-admission-webhook/0.log" Jun 05 21:23:19.509382 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:19.509343 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:19.629379 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:19.629353 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-5gnm7_982f450a-3056-4773-b6f4-a5f026cde0fb/networking-console-plugin/0.log" Jun 05 21:23:19.774205 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:19.774103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:23:19.774205 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:19.774156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:23:19.776631 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:19.776596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebede3cb-2f3e-4d4b-83ae-909de1f9e78b-metrics-tls\") pod \"dns-default-qvw5m\" (UID: \"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b\") " pod="openshift-dns/dns-default-qvw5m" Jun 05 21:23:19.776758 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:19.776635 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"image-registry-5889d45f-xmtnq\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:23:20.001625 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.001595 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6hvj9\"" Jun 05 21:23:20.001625 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.001594 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k5klj\"" Jun 05 21:23:20.008748 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.008722 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvw5m" Jun 05 21:23:20.008899 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.008771 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:23:20.156453 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.156425 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvw5m"] Jun 05 21:23:20.159386 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:23:20.159353 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebede3cb_2f3e_4d4b_83ae_909de1f9e78b.slice/crio-a15d225cfcc3c3ba4e0a34044be50bf01ccd96a567b9f0c2fad6683fdfee2fbe WatchSource:0}: Error finding container a15d225cfcc3c3ba4e0a34044be50bf01ccd96a567b9f0c2fad6683fdfee2fbe: Status 404 returned error can't find the container with id a15d225cfcc3c3ba4e0a34044be50bf01ccd96a567b9f0c2fad6683fdfee2fbe Jun 05 21:23:20.179921 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.179862 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5889d45f-xmtnq"] Jun 05 21:23:20.182098 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:23:20.182072 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87937b3e_5e2c_4f19_a86d_9ce1cb449e5c.slice/crio-8471ef821c926c4b11b87ef815de561ebe71bebe1d6351c8b7d9876e0ed1a1e0 WatchSource:0}: Error finding container 8471ef821c926c4b11b87ef815de561ebe71bebe1d6351c8b7d9876e0ed1a1e0: Status 404 returned error can't find the container with id 8471ef821c926c4b11b87ef815de561ebe71bebe1d6351c8b7d9876e0ed1a1e0 Jun 05 21:23:20.227408 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.227380 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57b4bdcf48-59scc_df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a/console/0.log" Jun 05 21:23:20.416077 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.415977 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" event={"ID":"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c","Type":"ContainerStarted","Data":"1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea"} Jun 05 21:23:20.416077 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.416039 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" event={"ID":"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c","Type":"ContainerStarted","Data":"8471ef821c926c4b11b87ef815de561ebe71bebe1d6351c8b7d9876e0ed1a1e0"} Jun 05 21:23:20.416077 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.416067 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:23:20.417284 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.417257 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvw5m" event={"ID":"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b","Type":"ContainerStarted","Data":"a15d225cfcc3c3ba4e0a34044be50bf01ccd96a567b9f0c2fad6683fdfee2fbe"} Jun 05 21:23:20.435663 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:20.435588 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" podStartSLOduration=284.435565282 podStartE2EDuration="4m44.435565282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:23:20.434488795 +0000 UTC m=+285.502898695" watchObservedRunningTime="2026-06-05 21:23:20.435565282 +0000 UTC m=+285.503975182" Jun 05 21:23:22.426336 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:22.426306 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hlhxh_9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c/dns-node-resolver/0.log" Jun 05 21:23:22.427828 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:22.427797 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvw5m" event={"ID":"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b","Type":"ContainerStarted","Data":"dfe61a1ffcb2dfce00c4fdc997251a6ff7589842898a9ca8d8e0704db031aa61"} Jun 05 21:23:22.428151 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:22.427968 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qvw5m" Jun 05 21:23:22.428151 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:22.428006 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvw5m" event={"ID":"ebede3cb-2f3e-4d4b-83ae-909de1f9e78b","Type":"ContainerStarted","Data":"0be37323ff44930984f7576b09f9c7ca1187af26b5f3688875aeac9510837a84"} Jun 05 21:23:22.429249 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:22.429229 2567 generic.go:356] "Generic (PLEG): container finished" podID="998edffc-37fa-4c24-bc4b-38af52c4a3f3" containerID="325e4f242e67b2e779f5d3ebd63b1c4ff695dd78028e677b4fa314224f91348f" exitCode=0 Jun 05 21:23:22.429337 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:22.429285 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" event={"ID":"998edffc-37fa-4c24-bc4b-38af52c4a3f3","Type":"ContainerDied","Data":"325e4f242e67b2e779f5d3ebd63b1c4ff695dd78028e677b4fa314224f91348f"} Jun 05 21:23:22.429573 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:22.429560 2567 scope.go:117] "RemoveContainer" containerID="325e4f242e67b2e779f5d3ebd63b1c4ff695dd78028e677b4fa314224f91348f" Jun 05 21:23:22.446485 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:22.446439 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qvw5m" podStartSLOduration=251.87866652 podStartE2EDuration="4m13.446423049s" totalImagesPullingTime="1.567756529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:23:22.444610116 +0000 UTC m=+287.513020016" watchObservedRunningTime="2026-06-05 21:23:22.446423049 +0000 UTC m=+287.514832948" Jun 05 21:23:22.826544 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:22.826518 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5889d45f-xmtnq_87937b3e-5e2c-4f19-a86d-9ce1cb449e5c/registry/0.log" Jun 05 21:23:23.225881 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:23.225806 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-crm5k_5e0ece63-babe-4f8b-a960-33ea46fe7da7/node-ca/0.log" Jun 05 21:23:23.439486 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:23.439453 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-g4jrp" event={"ID":"998edffc-37fa-4c24-bc4b-38af52c4a3f3","Type":"ContainerStarted","Data":"8746764bece5c6ec4572ca42a19acf4b6b07604e995274ea73016c99859a6c92"} Jun 05 21:23:23.626543 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:23.626516 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6478957989-b8l59_1461e6c9-bae6-4d82-8c47-381a5c59537e/router/0.log" Jun 05 21:23:23.827231 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:23.827199 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c85sh_54379baf-13d5-418c-acea-be62ec48b079/serve-healthcheck-canary/0.log" Jun 05 21:23:25.549492 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:25.549457 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:25.606412 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:25.606382 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:27.888515 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:27.888466 2567 patch_prober.go:28] interesting pod/console-57b4bdcf48-59scc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" start-of-body= Jun 05 21:23:27.888986 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:27.888528 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-57b4bdcf48-59scc" podUID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" containerName="console" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused" Jun 05 21:23:29.188640 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:29.188581 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:29.238342 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:29.238296 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:32.441952 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:32.441921 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qvw5m" Jun 05 21:23:35.382598 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:35.382569 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 21:23:36.324767 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:36.324725 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b4bdcf48-59scc"] Jun 05 21:23:36.421284 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:36.421243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:36.521860 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:36.521824 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:36.575600 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:36.575518 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:36.790916 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:36.790873 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:36.848047 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:36.847953 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:40.013579 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:40.013544 2567 patch_prober.go:28] interesting pod/image-registry-5889d45f-xmtnq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:23:40.013953 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:40.013595 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" podUID="87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:23:41.426281 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:41.426252 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:23:41.555868 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:41.555832 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:41.707948 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:41.707863 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:41.758940 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:41.758900 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:43.131202 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:43.131170 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:43.184307 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:43.184272 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:49.058407 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:49.058373 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5889d45f-xmtnq"] Jun 05 21:23:49.128914 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:49.128874 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:49.227886 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:49.227841 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:49.327855 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:49.327768 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:49.378254 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:49.378217 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:53.506945 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:53.506911 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:53.607894 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:53.607861 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:54.097174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:54.097137 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:54.370931 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:54.370846 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:55.165680 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.165641 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:23:55.166111 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.165936 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="alertmanager" containerID="cri-o://f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952" gracePeriod=120 Jun 05 21:23:55.166111 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.165992 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy-metric" containerID="cri-o://86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a" gracePeriod=120 Jun 05 21:23:55.166111 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.166020 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="config-reloader" containerID="cri-o://8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8" gracePeriod=120 Jun 05 21:23:55.166111 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.166040 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy-web" containerID="cri-o://561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932" gracePeriod=120 Jun 05 21:23:55.166111 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.166054 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="prom-label-proxy" containerID="cri-o://0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402" gracePeriod=120 Jun 05 21:23:55.166354 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.166088 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy" containerID="cri-o://381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d" gracePeriod=120 Jun 05 21:23:55.551034 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.551004 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:55.586418 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.586386 2567 generic.go:356] "Generic (PLEG): container finished" podID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerID="0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402" exitCode=0 Jun 05 21:23:55.586418 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.586415 2567 generic.go:356] "Generic (PLEG): container finished" podID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerID="381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d" exitCode=0 Jun 05 21:23:55.586418 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.586424 2567 generic.go:356] "Generic (PLEG): container finished" podID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerID="8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8" exitCode=0 Jun 05 21:23:55.586643 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.586432 2567 generic.go:356] "Generic (PLEG): container finished" podID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerID="f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952" exitCode=0 Jun 05 21:23:55.586643 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.586462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerDied","Data":"0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402"} Jun 05 21:23:55.586643 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.586521 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerDied","Data":"381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d"} Jun 05 21:23:55.586643 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.586549 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerDied","Data":"8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8"} Jun 05 21:23:55.586643 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.586573 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerDied","Data":"f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952"} Jun 05 21:23:55.607444 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:55.607412 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:56.393697 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.393666 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:56.422081 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.422057 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.453959 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.453922 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:56.510573 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.510537 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-web-config\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.510742 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.510583 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-metrics-client-ca\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.510742 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.510601 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxlks\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-kube-api-access-wxlks\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.510742 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.510632 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-web\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.510742 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.510657 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-cluster-tls-config\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.510742 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.510676 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-trusted-ca-bundle\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.510742 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.510702 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-main-tls\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.510742 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.510729 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-out\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.511107 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.510757 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-main-db\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.511107 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.511041 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:23:56.511107 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.511081 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:23:56.511262 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.511141 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-tls-assets\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.511262 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.511188 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.511262 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.511216 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-volume\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.511262 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.511251 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy\") pod \"97d891fa-8acc-463d-ad5c-351f82d52ffa\" (UID: \"97d891fa-8acc-463d-ad5c-351f82d52ffa\") " Jun 05 21:23:56.511605 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.511584 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-metrics-client-ca\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.511690 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.511610 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-main-db\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.511884 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.511133 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:23:56.513313 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.513288 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-kube-api-access-wxlks" (OuterVolumeSpecName: "kube-api-access-wxlks") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "kube-api-access-wxlks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:23:56.513735 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.513705 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-out" (OuterVolumeSpecName: "config-out") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:23:56.514280 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.513960 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:23:56.514280 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.514233 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:56.514785 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.514277 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:56.515069 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.515044 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:56.515537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.515515 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:56.516210 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.516189 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-volume" (OuterVolumeSpecName: "config-volume") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:56.518115 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.518086 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:56.525604 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.525574 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-web-config" (OuterVolumeSpecName: "web-config") pod "97d891fa-8acc-463d-ad5c-351f82d52ffa" (UID: "97d891fa-8acc-463d-ad5c-351f82d52ffa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:23:56.594384 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.594319 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:56.595052 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.595027 2567 generic.go:356] "Generic (PLEG): container finished" podID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerID="86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a" exitCode=0 Jun 05 21:23:56.595052 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.595048 2567 generic.go:356] "Generic (PLEG): container finished" podID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerID="561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932" exitCode=0 Jun 05 21:23:56.595207 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.595113 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerDied","Data":"86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a"} Jun 05 21:23:56.595249 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.595125 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.595249 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.595218 2567 scope.go:117] "RemoveContainer" containerID="0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402" Jun 05 21:23:56.595305 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.595206 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerDied","Data":"561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932"} Jun 05 21:23:56.595362 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.595353 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"97d891fa-8acc-463d-ad5c-351f82d52ffa","Type":"ContainerDied","Data":"e967ab068a0380a85254223a3c4690dc72866a8e6810d4256b76c752a79ab624"} Jun 05 21:23:56.605823 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.605801 2567 scope.go:117] "RemoveContainer" containerID="86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a" Jun 05 21:23:56.612063 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612039 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-web-config\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612063 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612065 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxlks\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-kube-api-access-wxlks\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612080 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612093 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-cluster-tls-config\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612106 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97d891fa-8acc-463d-ad5c-351f82d52ffa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612119 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-main-tls\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612132 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-out\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612143 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/97d891fa-8acc-463d-ad5c-351f82d52ffa-tls-assets\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612156 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612170 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-config-volume\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.612260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.612182 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97d891fa-8acc-463d-ad5c-351f82d52ffa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:23:56.613950 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.613931 2567 scope.go:117] "RemoveContainer" containerID="381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d" Jun 05 21:23:56.619287 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.619258 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:23:56.622491 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.622470 2567 scope.go:117] "RemoveContainer" containerID="561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932" Jun 05 21:23:56.623269 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.623245 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:23:56.629929 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.629907 2567 scope.go:117] "RemoveContainer" containerID="8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8" Jun 05 21:23:56.637587 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.637566 2567 scope.go:117] "RemoveContainer" containerID="f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952" Jun 05 21:23:56.648236 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648213 2567 scope.go:117] "RemoveContainer" containerID="ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a" Jun 05 21:23:56.648373 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648313 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:23:56.648680 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648666 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy" Jun 05 21:23:56.648732 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648682 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy" Jun 05 21:23:56.648732 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648695 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="config-reloader" Jun 05 21:23:56.648732 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648702 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="config-reloader" Jun 05 21:23:56.648732 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648714 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy-web" Jun 05 21:23:56.648732 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648722 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy-web" Jun 05 21:23:56.648732 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648728 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="prom-label-proxy" Jun 05 21:23:56.648732 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648734 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="prom-label-proxy" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648743 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy-metric" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648748 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy-metric" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648755 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="alertmanager" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648761 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="alertmanager" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648769 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="init-config-reloader" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648774 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="init-config-reloader" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648847 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="config-reloader" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648857 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648864 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy-web" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648874 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="prom-label-proxy" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648884 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="alertmanager" Jun 05 21:23:56.649013 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.648890 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" containerName="kube-rbac-proxy-metric" Jun 05 21:23:56.654137 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.654106 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.656614 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.656597 2567 scope.go:117] "RemoveContainer" containerID="0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402" Jun 05 21:23:56.656687 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.656667 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 21:23:56.656871 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.656810 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qwq6j\"" Jun 05 21:23:56.656871 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.656864 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 21:23:56.657012 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.656907 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 21:23:56.657012 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.656945 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 21:23:56.657012 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.656944 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 21:23:56.657140 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.657026 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 21:23:56.657140 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:23:56.657033 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402\": container with ID starting with 0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402 not found: ID does not exist" containerID="0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402" Jun 05 21:23:56.657140 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.657069 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402"} err="failed to get container status \"0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402\": rpc error: code = NotFound desc = could not find container \"0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402\": container with ID starting with 0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402 not found: ID does not exist" Jun 05 21:23:56.657140 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.657113 2567 scope.go:117] "RemoveContainer" containerID="86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a" Jun 05 21:23:56.657360 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.657219 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 21:23:56.657360 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.657231 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 21:23:56.657464 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:23:56.657442 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a\": container with ID starting with 86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a not found: ID does not exist" containerID="86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a" Jun 05 21:23:56.657517 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.657468 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a"} err="failed to get container status \"86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a\": rpc error: code = NotFound desc = could not find container \"86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a\": container with ID starting with 86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a not found: ID does not exist" Jun 05 21:23:56.657517 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.657489 2567 scope.go:117] "RemoveContainer" containerID="381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d" Jun 05 21:23:56.657800 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:23:56.657739 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d\": container with ID starting with 381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d not found: ID does not exist" containerID="381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d" Jun 05 21:23:56.657889 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.657829 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d"} err="failed to get container status \"381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d\": rpc error: code = NotFound desc = could not find container \"381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d\": container with ID starting with 381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d not found: ID does not exist" Jun 05 21:23:56.657889 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.657856 2567 scope.go:117] "RemoveContainer" containerID="561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932" Jun 05 21:23:56.658128 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:23:56.658106 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932\": container with ID starting with 561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932 not found: ID does not exist" containerID="561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932" Jun 05 21:23:56.658188 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.658135 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932"} err="failed to get container status \"561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932\": rpc error: code = NotFound desc = could not find container \"561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932\": container with ID starting with 561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932 not found: ID does not exist" Jun 05 21:23:56.658188 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.658155 2567 scope.go:117] "RemoveContainer" containerID="8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8" Jun 05 21:23:56.658416 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:23:56.658398 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8\": container with ID starting with 8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8 not found: ID does not exist" containerID="8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8" Jun 05 21:23:56.658467 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.658422 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8"} err="failed to get container status \"8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8\": rpc error: code = NotFound desc = could not find container \"8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8\": container with ID starting with 8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8 not found: ID does not exist" Jun 05 21:23:56.658467 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.658442 2567 scope.go:117] "RemoveContainer" containerID="f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952" Jun 05 21:23:56.658743 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:23:56.658716 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952\": container with ID starting with f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952 not found: ID does not exist" containerID="f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952" Jun 05 21:23:56.658847 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.658748 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952"} err="failed to get container status \"f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952\": rpc error: code = NotFound desc = could not find container \"f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952\": container with ID starting with f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952 not found: ID does not exist" Jun 05 21:23:56.658847 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.658786 2567 scope.go:117] "RemoveContainer" containerID="ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a" Jun 05 21:23:56.659086 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:23:56.659062 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a\": container with ID starting with ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a not found: ID does not exist" containerID="ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a" Jun 05 21:23:56.659214 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.659093 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a"} err="failed to get container status \"ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a\": rpc error: code = NotFound desc = could not find container \"ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a\": container with ID starting with ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a not found: ID does not exist" Jun 05 21:23:56.659214 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.659115 2567 scope.go:117] "RemoveContainer" containerID="0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402" Jun 05 21:23:56.659401 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.659377 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402"} err="failed to get container status \"0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402\": rpc error: code = NotFound desc = could not find container \"0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402\": container with ID starting with 0a0135fa454c4d0d6c137d3afa291b3ef11b1a3dc13559a5e4eb30e88b241402 not found: ID does not exist" Jun 05 21:23:56.659463 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.659404 2567 scope.go:117] "RemoveContainer" containerID="86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a" Jun 05 21:23:56.659676 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.659641 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a"} err="failed to get container status \"86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a\": rpc error: code = NotFound desc = could not find container \"86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a\": container with ID starting with 86766d2f957e7669a71ce24332b7d496629eba41cfa89ee5ff1b7fac300af69a not found: ID does not exist" Jun 05 21:23:56.659741 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.659679 2567 scope.go:117] "RemoveContainer" containerID="381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d" Jun 05 21:23:56.659956 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.659933 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d"} err="failed to get container status \"381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d\": rpc error: code = NotFound desc = could not find container \"381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d\": container with ID starting with 381bd4b5f8e11cf59dbdf63e1c7362468182ffc73830c50de014faedc0ea867d not found: ID does not exist" Jun 05 21:23:56.660043 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.659958 2567 scope.go:117] "RemoveContainer" containerID="561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932" Jun 05 21:23:56.660194 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.660176 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932"} err="failed to get container status \"561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932\": rpc error: code = NotFound desc = could not find container \"561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932\": container with ID starting with 561d415dcd9dd6c70ee4206a01de9c7614f5a4f8f9906c0303c722b9f2eae932 not found: ID does not exist" Jun 05 21:23:56.660262 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.660196 2567 scope.go:117] "RemoveContainer" containerID="8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8" Jun 05 21:23:56.660442 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.660425 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8"} err="failed to get container status \"8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8\": rpc error: code = NotFound desc = could not find container \"8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8\": container with ID starting with 8c8f6fbb2cdc0402f13ebea55ded881cc2ad3f4c69ddf77db7bcc2b1d48b14e8 not found: ID does not exist" Jun 05 21:23:56.660524 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.660443 2567 scope.go:117] "RemoveContainer" containerID="f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952" Jun 05 21:23:56.660675 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.660652 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952"} err="failed to get container status \"f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952\": rpc error: code = NotFound desc = could not find container \"f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952\": container with ID starting with f8672b1b0fcbc379325a9e7ae0a083a9d66762a88ff6dd919a62c79225354952 not found: ID does not exist" Jun 05 21:23:56.660731 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.660678 2567 scope.go:117] "RemoveContainer" containerID="ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a" Jun 05 21:23:56.660955 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.660935 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a"} err="failed to get container status \"ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a\": rpc error: code = NotFound desc = could not find container \"ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a\": container with ID starting with ee675c85f6131dcaf0961eede451ce80bd11de97e397af390b8663534197cb6a not found: ID does not exist" Jun 05 21:23:56.661482 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.661460 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 21:23:56.667482 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.667452 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:23:56.712610 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fceb2-d040-4036-80dc-ac21c69f2f63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.712804 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712662 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.712804 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712702 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d66fceb2-d040-4036-80dc-ac21c69f2f63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.712804 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712727 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-config-volume\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.712804 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712799 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d66fceb2-d040-4036-80dc-ac21c69f2f63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.713015 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d66fceb2-d040-4036-80dc-ac21c69f2f63-config-out\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.713015 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.713015 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw45m\" (UniqueName: \"kubernetes.io/projected/d66fceb2-d040-4036-80dc-ac21c69f2f63-kube-api-access-hw45m\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.713015 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712893 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.713015 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712910 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-web-config\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.713015 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.712998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.713313 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.713040 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d66fceb2-d040-4036-80dc-ac21c69f2f63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.713313 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.713092 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.813893 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.813805 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d66fceb2-d040-4036-80dc-ac21c69f2f63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.813893 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.813850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d66fceb2-d040-4036-80dc-ac21c69f2f63-config-out\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.813893 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.813875 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.813902 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw45m\" (UniqueName: \"kubernetes.io/projected/d66fceb2-d040-4036-80dc-ac21c69f2f63-kube-api-access-hw45m\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.813928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.813944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-web-config\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.814085 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.814123 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d66fceb2-d040-4036-80dc-ac21c69f2f63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.814181 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.814243 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fceb2-d040-4036-80dc-ac21c69f2f63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.814278 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814352 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.814308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d66fceb2-d040-4036-80dc-ac21c69f2f63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.814828 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.814380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-config-volume\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.815571 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.814988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d66fceb2-d040-4036-80dc-ac21c69f2f63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.815571 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.815246 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d66fceb2-d040-4036-80dc-ac21c69f2f63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.817144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.816714 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d66fceb2-d040-4036-80dc-ac21c69f2f63-config-out\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.817144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.816999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.817144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.817071 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-web-config\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.817144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.817138 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.817431 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.817208 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-config-volume\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.817492 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.817449 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.817845 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.817822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d66fceb2-d040-4036-80dc-ac21c69f2f63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.817924 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.817908 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.818384 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.818363 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d66fceb2-d040-4036-80dc-ac21c69f2f63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.819073 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.819056 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d66fceb2-d040-4036-80dc-ac21c69f2f63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.821675 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.821656 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw45m\" (UniqueName: \"kubernetes.io/projected/d66fceb2-d040-4036-80dc-ac21c69f2f63-kube-api-access-hw45m\") pod \"alertmanager-main-0\" (UID: \"d66fceb2-d040-4036-80dc-ac21c69f2f63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:56.968815 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:56.968780 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:23:57.109351 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:57.109315 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:23:57.111302 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:23:57.111276 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66fceb2_d040_4036_80dc_ac21c69f2f63.slice/crio-d58feabc9b56fb9ace7a155f4432284730f73413ba27deee680476b61b492801 WatchSource:0}: Error finding container d58feabc9b56fb9ace7a155f4432284730f73413ba27deee680476b61b492801: Status 404 returned error can't find the container with id d58feabc9b56fb9ace7a155f4432284730f73413ba27deee680476b61b492801 Jun 05 21:23:57.437647 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:57.437557 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97d891fa-8acc-463d-ad5c-351f82d52ffa" path="/var/lib/kubelet/pods/97d891fa-8acc-463d-ad5c-351f82d52ffa/volumes" Jun 05 21:23:57.601970 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:57.601934 2567 generic.go:356] "Generic (PLEG): container finished" podID="d66fceb2-d040-4036-80dc-ac21c69f2f63" containerID="3e3997bf2b9b8ed2ca58a2eb99d06333e0d7b412406aaa228647c2d0b3b82f11" exitCode=0 Jun 05 21:23:57.602114 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:57.602021 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d66fceb2-d040-4036-80dc-ac21c69f2f63","Type":"ContainerDied","Data":"3e3997bf2b9b8ed2ca58a2eb99d06333e0d7b412406aaa228647c2d0b3b82f11"} Jun 05 21:23:57.602114 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:57.602100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d66fceb2-d040-4036-80dc-ac21c69f2f63","Type":"ContainerStarted","Data":"d58feabc9b56fb9ace7a155f4432284730f73413ba27deee680476b61b492801"} Jun 05 21:23:58.609802 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:58.609766 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d66fceb2-d040-4036-80dc-ac21c69f2f63","Type":"ContainerStarted","Data":"6676d43b4448fbfd34a46fa59f7c8b129c69ef7e23615ff2da2f9037ebdd739e"} Jun 05 21:23:58.610165 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:58.609860 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d66fceb2-d040-4036-80dc-ac21c69f2f63","Type":"ContainerStarted","Data":"6d9dff1064a60c54cf5c00851c9d52194e4feed4431e323cbb3fd0cb136bd4d1"} Jun 05 21:23:58.610165 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:58.609888 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d66fceb2-d040-4036-80dc-ac21c69f2f63","Type":"ContainerStarted","Data":"e41a16cb0a8c79fe17f4b03c14fabe10e6b42e7e31420fa0dc12c268aab7f95b"} Jun 05 21:23:58.610165 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:58.609912 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d66fceb2-d040-4036-80dc-ac21c69f2f63","Type":"ContainerStarted","Data":"0ece19646f9453a375b79f8e894f4afbeebcf93cf592b0abab3be576169b2ce0"} Jun 05 21:23:58.610165 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:58.609935 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d66fceb2-d040-4036-80dc-ac21c69f2f63","Type":"ContainerStarted","Data":"a1bf23400ea706f5f12613bbfecfad8c068b9eedd222cf1d272ecf3042feadbb"} Jun 05 21:23:58.610165 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:58.609957 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d66fceb2-d040-4036-80dc-ac21c69f2f63","Type":"ContainerStarted","Data":"ed77a2f176e806ed70b78d34ea54ec746012532e9beefdd85b4dcf7bb36c400f"} Jun 05 21:23:58.644080 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:58.644027 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.627543094 podStartE2EDuration="2.64400928s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.466186ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:23:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:23:58.641238436 +0000 UTC m=+323.709648372" watchObservedRunningTime="2026-06-05 21:23:58.64400928 +0000 UTC m=+323.712419179" Jun 05 21:23:59.208006 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.207965 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-757f54cd6d-qlvk5"] Jun 05 21:23:59.211661 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.211629 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.214512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.214484 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 05 21:23:59.214979 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.214963 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 05 21:23:59.215071 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.214994 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 05 21:23:59.215264 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.215248 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 05 21:23:59.215310 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.215264 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 05 21:23:59.215383 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.215358 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-shgrb\"" Jun 05 21:23:59.222295 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.222270 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 05 21:23:59.235878 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.235845 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-757f54cd6d-qlvk5"] Jun 05 21:23:59.338360 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.338292 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f929182-fec7-4a14-9a3d-997d3c5ea860-serving-certs-ca-bundle\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.338603 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.338583 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-secret-telemeter-client\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.339054 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.338720 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f929182-fec7-4a14-9a3d-997d3c5ea860-metrics-client-ca\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.339054 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.338757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f929182-fec7-4a14-9a3d-997d3c5ea860-telemeter-trusted-ca-bundle\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.339054 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.338806 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-telemeter-client-tls\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.339054 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.338852 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-federate-client-tls\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.339054 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.338878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmvk9\" (UniqueName: \"kubernetes.io/projected/1f929182-fec7-4a14-9a3d-997d3c5ea860-kube-api-access-kmvk9\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.339054 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.338923 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.439469 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.439432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-federate-client-tls\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.439689 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.439485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmvk9\" (UniqueName: \"kubernetes.io/projected/1f929182-fec7-4a14-9a3d-997d3c5ea860-kube-api-access-kmvk9\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.439689 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.439535 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.439689 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.439576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f929182-fec7-4a14-9a3d-997d3c5ea860-serving-certs-ca-bundle\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.439689 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.439604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-secret-telemeter-client\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.439689 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.439646 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f929182-fec7-4a14-9a3d-997d3c5ea860-metrics-client-ca\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.439689 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.439682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f929182-fec7-4a14-9a3d-997d3c5ea860-telemeter-trusted-ca-bundle\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.440018 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.439725 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-telemeter-client-tls\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.440396 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.440371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f929182-fec7-4a14-9a3d-997d3c5ea860-serving-certs-ca-bundle\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.440792 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.440768 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f929182-fec7-4a14-9a3d-997d3c5ea860-metrics-client-ca\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.441040 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.440969 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f929182-fec7-4a14-9a3d-997d3c5ea860-telemeter-trusted-ca-bundle\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.442422 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.442391 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-federate-client-tls\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.442422 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.442414 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.442570 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.442391 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-telemeter-client-tls\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.442570 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.442505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1f929182-fec7-4a14-9a3d-997d3c5ea860-secret-telemeter-client\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.455046 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.455021 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmvk9\" (UniqueName: \"kubernetes.io/projected/1f929182-fec7-4a14-9a3d-997d3c5ea860-kube-api-access-kmvk9\") pod \"telemeter-client-757f54cd6d-qlvk5\" (UID: \"1f929182-fec7-4a14-9a3d-997d3c5ea860\") " pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.523874 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.523836 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" Jun 05 21:23:59.627362 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.627297 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:59.688243 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.688213 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-757f54cd6d-qlvk5"] Jun 05 21:23:59.688863 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.688825 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:59.690759 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:23:59.690728 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f929182_fec7_4a14_9a3d_997d3c5ea860.slice/crio-a698abe28eab440d77776dbe552e8ab56d6d24c8ac72b2a2c18ec16189de3162 WatchSource:0}: Error finding container a698abe28eab440d77776dbe552e8ab56d6d24c8ac72b2a2c18ec16189de3162: Status 404 returned error can't find the container with id a698abe28eab440d77776dbe552e8ab56d6d24c8ac72b2a2c18ec16189de3162 Jun 05 21:23:59.692758 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:23:59.692744 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:24:00.623677 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:00.623625 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" event={"ID":"1f929182-fec7-4a14-9a3d-997d3c5ea860","Type":"ContainerStarted","Data":"a698abe28eab440d77776dbe552e8ab56d6d24c8ac72b2a2c18ec16189de3162"} Jun 05 21:24:01.345490 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.345440 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57b4bdcf48-59scc" podUID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" containerName="console" containerID="cri-o://6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070" gracePeriod=15 Jun 05 21:24:01.604160 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.604131 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:24:01.630983 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.630939 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" event={"ID":"1f929182-fec7-4a14-9a3d-997d3c5ea860","Type":"ContainerStarted","Data":"40b5f0908a790bb5c491d7d13ae2c8cbd7ee03c3f8b5599f5b8dccfe7dc05eb6"} Jun 05 21:24:01.631184 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.631019 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" event={"ID":"1f929182-fec7-4a14-9a3d-997d3c5ea860","Type":"ContainerStarted","Data":"4901f9ba3486eb7fc8fa818b45a245bb75e28cbf55cf9a56c86b9c44ca68df4c"} Jun 05 21:24:01.631184 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.631051 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" event={"ID":"1f929182-fec7-4a14-9a3d-997d3c5ea860","Type":"ContainerStarted","Data":"11b98b3829c3e03a6eb03f6384aa5d5b1e7cffa7934bcfef57b297c54eb98dbc"} Jun 05 21:24:01.632263 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.632238 2567 generic.go:356] "Generic (PLEG): container finished" podID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" containerID="6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070" exitCode=0 Jun 05 21:24:01.632387 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.632276 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b4bdcf48-59scc" Jun 05 21:24:01.632387 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.632283 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b4bdcf48-59scc" event={"ID":"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a","Type":"ContainerDied","Data":"6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070"} Jun 05 21:24:01.632468 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.632392 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b4bdcf48-59scc" event={"ID":"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a","Type":"ContainerDied","Data":"9c0793e0cff5e8cabb806f106a6fb285277299835ff956e93b4ad5466dfc82cf"} Jun 05 21:24:01.632468 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.632430 2567 scope.go:117] "RemoveContainer" containerID="6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070" Jun 05 21:24:01.640774 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.640752 2567 scope.go:117] "RemoveContainer" containerID="6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070" Jun 05 21:24:01.641101 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:24:01.641076 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070\": container with ID starting with 6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070 not found: ID does not exist" containerID="6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070" Jun 05 21:24:01.641161 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.641115 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070"} err="failed to get container status \"6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070\": rpc error: code = NotFound desc = could not find container \"6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070\": container with ID starting with 6d2da2f712565d1807ed711b17d7d9ccfc4783ee0cb9dddba90430f87b74d070 not found: ID does not exist" Jun 05 21:24:01.656750 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.656699 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-757f54cd6d-qlvk5" podStartSLOduration=1.099899853 podStartE2EDuration="2.656680245s" totalImagesPullingTime="1.556780392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:24:01.655291236 +0000 UTC m=+326.723701135" watchObservedRunningTime="2026-06-05 21:24:01.656680245 +0000 UTC m=+326.725090144" Jun 05 21:24:01.660104 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660069 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-config\") pod \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " Jun 05 21:24:01.660270 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660115 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-oauth-serving-cert\") pod \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " Jun 05 21:24:01.660270 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660185 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-serving-cert\") pod \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " Jun 05 21:24:01.660270 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660213 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppwdm\" (UniqueName: \"kubernetes.io/projected/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-kube-api-access-ppwdm\") pod \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " Jun 05 21:24:01.660270 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660244 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-oauth-config\") pod \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " Jun 05 21:24:01.660504 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660306 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-service-ca\") pod \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\" (UID: \"df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a\") " Jun 05 21:24:01.660560 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660525 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-config" (OuterVolumeSpecName: "console-config") pod "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" (UID: "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:24:01.660624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660530 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" (UID: "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:24:01.660678 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660626 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-config\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:01.660883 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.660857 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-service-ca" (OuterVolumeSpecName: "service-ca") pod "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" (UID: "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:24:01.663028 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.662998 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" (UID: "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:24:01.663130 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.663046 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-kube-api-access-ppwdm" (OuterVolumeSpecName: "kube-api-access-ppwdm") pod "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" (UID: "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a"). InnerVolumeSpecName "kube-api-access-ppwdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:24:01.663682 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.663644 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" (UID: "df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:24:01.762136 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.761893 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-serving-cert\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:01.762136 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.761933 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppwdm\" (UniqueName: \"kubernetes.io/projected/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-kube-api-access-ppwdm\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:01.762136 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.761948 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-console-oauth-config\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:01.762136 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.761962 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-service-ca\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:01.762136 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.761977 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a-oauth-serving-cert\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:01.961563 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.961525 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b4bdcf48-59scc"] Jun 05 21:24:01.969908 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:01.969878 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57b4bdcf48-59scc"] Jun 05 21:24:02.489124 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:02.489087 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:02.589652 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:02.589612 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:02.649601 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:02.649566 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:03.165844 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:03.165804 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:03.230235 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:03.230195 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:03.438214 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:03.438135 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" path="/var/lib/kubelet/pods/df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a/volumes" Jun 05 21:24:10.545620 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:10.545569 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:10.600048 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:10.600019 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:13.305030 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:13.305001 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:13.406998 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:13.406946 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:14.078726 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.078685 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" podUID="87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" containerName="registry" containerID="cri-o://1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea" gracePeriod=30 Jun 05 21:24:14.331573 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.331509 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:24:14.479012 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.478971 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn89d\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-kube-api-access-mn89d\") pod \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " Jun 05 21:24:14.479211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.479028 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-certificates\") pod \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " Jun 05 21:24:14.479211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.479050 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-image-registry-private-configuration\") pod \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " Jun 05 21:24:14.479211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.479078 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-installation-pull-secrets\") pod \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " Jun 05 21:24:14.479211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.479131 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") pod \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " Jun 05 21:24:14.479211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.479155 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-trusted-ca\") pod \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " Jun 05 21:24:14.479211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.479178 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-bound-sa-token\") pod \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " Jun 05 21:24:14.479211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.479197 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-ca-trust-extracted\") pod \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\" (UID: \"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c\") " Jun 05 21:24:14.479768 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.479716 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:24:14.480081 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.480061 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:24:14.481807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.481761 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:24:14.481911 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.481877 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:24:14.481911 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.481899 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:24:14.482005 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.481967 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:24:14.482048 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.482000 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-kube-api-access-mn89d" (OuterVolumeSpecName: "kube-api-access-mn89d") pod "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c"). InnerVolumeSpecName "kube-api-access-mn89d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:24:14.487955 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.487930 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" (UID: "87937b3e-5e2c-4f19-a86d-9ce1cb449e5c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:24:14.580423 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.580381 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-tls\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:14.580423 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.580415 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-trusted-ca\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:14.580423 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.580429 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-bound-sa-token\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:14.580700 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.580444 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-ca-trust-extracted\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:14.580700 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.580457 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn89d\" (UniqueName: \"kubernetes.io/projected/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-kube-api-access-mn89d\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:14.580700 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.580469 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-registry-certificates\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:14.580700 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.580483 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-image-registry-private-configuration\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:14.580700 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.580497 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c-installation-pull-secrets\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:24:14.691632 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.691537 2567 generic.go:356] "Generic (PLEG): container finished" podID="87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" containerID="1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea" exitCode=0 Jun 05 21:24:14.691632 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.691586 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" Jun 05 21:24:14.691879 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.691630 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" event={"ID":"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c","Type":"ContainerDied","Data":"1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea"} Jun 05 21:24:14.691879 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.691697 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5889d45f-xmtnq" event={"ID":"87937b3e-5e2c-4f19-a86d-9ce1cb449e5c","Type":"ContainerDied","Data":"8471ef821c926c4b11b87ef815de561ebe71bebe1d6351c8b7d9876e0ed1a1e0"} Jun 05 21:24:14.691879 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.691724 2567 scope.go:117] "RemoveContainer" containerID="1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea" Jun 05 21:24:14.705958 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.705937 2567 scope.go:117] "RemoveContainer" containerID="1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea" Jun 05 21:24:14.706238 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:24:14.706221 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea\": container with ID starting with 1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea not found: ID does not exist" containerID="1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea" Jun 05 21:24:14.706289 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.706244 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea"} err="failed to get container status \"1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea\": rpc error: code = NotFound desc = could not find container \"1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea\": container with ID starting with 1962ed5dd11d40d605bf51cf5034c8890295939152e1a4d1386f3c4a0048bbea not found: ID does not exist" Jun 05 21:24:14.716260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.716234 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5889d45f-xmtnq"] Jun 05 21:24:14.722404 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:14.722380 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5889d45f-xmtnq"] Jun 05 21:24:15.437698 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:15.437668 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" path="/var/lib/kubelet/pods/87937b3e-5e2c-4f19-a86d-9ce1cb449e5c/volumes" Jun 05 21:24:39.416806 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:39.416767 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:24:39.469071 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:24:39.469035 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:06.164154 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:06.164113 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:09.371147 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:09.371108 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:09.419035 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:09.419002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:21.249679 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:21.249644 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:21.306117 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:21.306086 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:25.548744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:25.548708 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:25.649641 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:25.649611 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:34.558272 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.558233 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd4555f47-rcdb5"] Jun 05 21:25:34.558684 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.558580 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" containerName="console" Jun 05 21:25:34.558684 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.558592 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" containerName="console" Jun 05 21:25:34.558684 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.558606 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" containerName="registry" Jun 05 21:25:34.558684 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.558611 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" containerName="registry" Jun 05 21:25:34.558684 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.558667 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="87937b3e-5e2c-4f19-a86d-9ce1cb449e5c" containerName="registry" Jun 05 21:25:34.558684 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.558674 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="df70518f-5899-4e8a-9b6e-e5f6b3d3ab3a" containerName="console" Jun 05 21:25:34.561671 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.561644 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.564092 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.564062 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 21:25:34.564229 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.564209 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 21:25:34.564293 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.564258 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 21:25:34.564575 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.564559 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 21:25:34.564933 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.564917 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 21:25:34.565019 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.564922 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hbt8c\"" Jun 05 21:25:34.565276 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.565257 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 21:25:34.565393 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.565260 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 21:25:34.569573 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.569551 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 21:25:34.574122 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.574097 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd4555f47-rcdb5"] Jun 05 21:25:34.643527 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.643479 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:34.702002 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.701949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:34.712063 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.712037 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-serving-cert\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.712174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.712073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-oauth-serving-cert\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.712174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.712152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-trusted-ca-bundle\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.712259 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.712184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-oauth-config\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.712259 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.712215 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-config\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.712259 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.712234 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-service-ca\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.712259 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.712251 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kswms\" (UniqueName: \"kubernetes.io/projected/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-kube-api-access-kswms\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.757174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.757142 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:34.812979 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.812892 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-oauth-serving-cert\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.812979 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.812959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-trusted-ca-bundle\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.812979 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.812982 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-oauth-config\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.813252 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.813009 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-config\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.813252 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.813026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-service-ca\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.813252 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.813043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kswms\" (UniqueName: \"kubernetes.io/projected/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-kube-api-access-kswms\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.813252 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.813071 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-serving-cert\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.813822 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.813793 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-oauth-serving-cert\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.813905 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.813797 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-service-ca\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.813905 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.813806 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-config\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.813905 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.813890 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-trusted-ca-bundle\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.815511 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.815488 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-oauth-config\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.815606 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.815596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-serving-cert\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.821759 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.821732 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kswms\" (UniqueName: \"kubernetes.io/projected/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-kube-api-access-kswms\") pod \"console-dd4555f47-rcdb5\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:34.871603 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:34.871561 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:35.006000 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:35.005967 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd4555f47-rcdb5"] Jun 05 21:25:35.009064 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:25:35.009029 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b82ae7_4822_4309_b1b0_bbbafe44f09b.slice/crio-146962d4c847a0135a64abaee4c98e3852b36a2a042c8e66e1d3b88ac5eaecde WatchSource:0}: Error finding container 146962d4c847a0135a64abaee4c98e3852b36a2a042c8e66e1d3b88ac5eaecde: Status 404 returned error can't find the container with id 146962d4c847a0135a64abaee4c98e3852b36a2a042c8e66e1d3b88ac5eaecde Jun 05 21:25:35.021099 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:35.021071 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd4555f47-rcdb5" event={"ID":"b6b82ae7-4822-4309-b1b0-bbbafe44f09b","Type":"ContainerStarted","Data":"146962d4c847a0135a64abaee4c98e3852b36a2a042c8e66e1d3b88ac5eaecde"} Jun 05 21:25:35.353910 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:35.353874 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:35.408415 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:35.408386 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:36.026266 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:36.026230 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd4555f47-rcdb5" event={"ID":"b6b82ae7-4822-4309-b1b0-bbbafe44f09b","Type":"ContainerStarted","Data":"75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293"} Jun 05 21:25:44.871933 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:44.871837 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:44.871933 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:44.871905 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:44.876819 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:44.876793 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:44.896650 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:44.896604 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dd4555f47-rcdb5" podStartSLOduration=10.896589695 podStartE2EDuration="10.896589695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:25:36.043102946 +0000 UTC m=+421.111512847" watchObservedRunningTime="2026-06-05 21:25:44.896589695 +0000 UTC m=+429.964999594" Jun 05 21:25:45.068294 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:45.068264 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:25:45.218498 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:45.218421 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:45.270077 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:45.270045 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:45.324258 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:25:45.324224 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:26:48.590118 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:26:48.590084 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:26:56.781949 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:26:56.781912 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:27:08.219174 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:27:08.219134 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:28:30.558583 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:28:30.558538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:28:31.725130 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:28:31.725088 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:28:32.699191 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:28:32.699147 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:28:32.800782 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:28:32.800744 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:07.591451 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:07.591358 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:07.647848 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:07.647809 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:10.044268 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.044229 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56db8c9576-msb92"] Jun 05 21:29:10.047429 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.047407 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.058656 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.058627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-service-ca\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.058782 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.058688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10f2394d-8159-459c-8c31-8f403afcac5d-console-oauth-config\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.058782 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.058718 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-console-config\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.058782 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.058747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-oauth-serving-cert\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.058782 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.058772 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-trusted-ca-bundle\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.058912 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.058798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10f2394d-8159-459c-8c31-8f403afcac5d-console-serving-cert\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.058912 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.058851 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgq87\" (UniqueName: \"kubernetes.io/projected/10f2394d-8159-459c-8c31-8f403afcac5d-kube-api-access-cgq87\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.070229 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.070196 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56db8c9576-msb92"] Jun 05 21:29:10.090581 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.090545 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:10.159955 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.159921 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-trusted-ca-bundle\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.160106 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.159972 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10f2394d-8159-459c-8c31-8f403afcac5d-console-serving-cert\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.160106 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.159995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgq87\" (UniqueName: \"kubernetes.io/projected/10f2394d-8159-459c-8c31-8f403afcac5d-kube-api-access-cgq87\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.160106 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.160037 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-service-ca\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.160106 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.160079 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10f2394d-8159-459c-8c31-8f403afcac5d-console-oauth-config\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.160106 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.160094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-console-config\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.160444 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.160119 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-oauth-serving-cert\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.160937 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.160910 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-oauth-serving-cert\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.161046 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.160942 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-service-ca\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.161046 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.160910 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-console-config\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.161046 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.160989 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10f2394d-8159-459c-8c31-8f403afcac5d-trusted-ca-bundle\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.162651 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.162627 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10f2394d-8159-459c-8c31-8f403afcac5d-console-serving-cert\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.162739 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.162688 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10f2394d-8159-459c-8c31-8f403afcac5d-console-oauth-config\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.168601 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.168578 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgq87\" (UniqueName: \"kubernetes.io/projected/10f2394d-8159-459c-8c31-8f403afcac5d-kube-api-access-cgq87\") pod \"console-56db8c9576-msb92\" (UID: \"10f2394d-8159-459c-8c31-8f403afcac5d\") " pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.357058 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.356957 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:10.492935 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.492901 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56db8c9576-msb92"] Jun 05 21:29:10.496397 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:29:10.496355 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f2394d_8159_459c_8c31_8f403afcac5d.slice/crio-546b89e2951a7e4605ad8e76d3ad0a875121c1bf203ffa46bbf3dd5ee2b01a3e WatchSource:0}: Error finding container 546b89e2951a7e4605ad8e76d3ad0a875121c1bf203ffa46bbf3dd5ee2b01a3e: Status 404 returned error can't find the container with id 546b89e2951a7e4605ad8e76d3ad0a875121c1bf203ffa46bbf3dd5ee2b01a3e Jun 05 21:29:10.908879 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.908839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db8c9576-msb92" event={"ID":"10f2394d-8159-459c-8c31-8f403afcac5d","Type":"ContainerStarted","Data":"4e352c1ce94976dee4baf42939de3c8e18c574b6f110bf1c1e8e27995e0040ef"} Jun 05 21:29:10.909067 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.908921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db8c9576-msb92" event={"ID":"10f2394d-8159-459c-8c31-8f403afcac5d","Type":"ContainerStarted","Data":"546b89e2951a7e4605ad8e76d3ad0a875121c1bf203ffa46bbf3dd5ee2b01a3e"} Jun 05 21:29:10.928512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:10.928436 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56db8c9576-msb92" podStartSLOduration=0.928417666 podStartE2EDuration="928.417666ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:29:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:29:10.926864808 +0000 UTC m=+635.995274699" watchObservedRunningTime="2026-06-05 21:29:10.928417666 +0000 UTC m=+635.996827650" Jun 05 21:29:20.357616 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:20.357575 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:20.358005 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:20.357644 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:20.362269 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:20.362246 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:20.954652 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:20.954625 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56db8c9576-msb92" Jun 05 21:29:21.000610 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:21.000573 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd4555f47-rcdb5"] Jun 05 21:29:21.113930 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:21.113903 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:21.214149 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:21.214060 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:21.280754 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:21.280712 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:25.652691 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:25.652658 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:25.705460 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:25.705430 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:46.024476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.024408 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-dd4555f47-rcdb5" podUID="b6b82ae7-4822-4309-b1b0-bbbafe44f09b" containerName="console" containerID="cri-o://75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293" gracePeriod=15 Jun 05 21:29:46.270372 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.270346 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:29:46.359855 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.359753 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-trusted-ca-bundle\") pod \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " Jun 05 21:29:46.359855 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.359806 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kswms\" (UniqueName: \"kubernetes.io/projected/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-kube-api-access-kswms\") pod \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " Jun 05 21:29:46.360092 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.359886 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-config\") pod \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " Jun 05 21:29:46.360092 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.359933 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-oauth-config\") pod \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " Jun 05 21:29:46.360092 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.359960 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-service-ca\") pod \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " Jun 05 21:29:46.360092 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.359984 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-oauth-serving-cert\") pod \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " Jun 05 21:29:46.360092 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.360030 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-serving-cert\") pod \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\" (UID: \"b6b82ae7-4822-4309-b1b0-bbbafe44f09b\") " Jun 05 21:29:46.360369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.360237 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b6b82ae7-4822-4309-b1b0-bbbafe44f09b" (UID: "b6b82ae7-4822-4309-b1b0-bbbafe44f09b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:29:46.360499 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.360467 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6b82ae7-4822-4309-b1b0-bbbafe44f09b" (UID: "b6b82ae7-4822-4309-b1b0-bbbafe44f09b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:29:46.360499 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.360488 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6b82ae7-4822-4309-b1b0-bbbafe44f09b" (UID: "b6b82ae7-4822-4309-b1b0-bbbafe44f09b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:29:46.360647 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.360496 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-config" (OuterVolumeSpecName: "console-config") pod "b6b82ae7-4822-4309-b1b0-bbbafe44f09b" (UID: "b6b82ae7-4822-4309-b1b0-bbbafe44f09b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:29:46.362298 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.362277 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6b82ae7-4822-4309-b1b0-bbbafe44f09b" (UID: "b6b82ae7-4822-4309-b1b0-bbbafe44f09b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:29:46.362393 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.362348 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6b82ae7-4822-4309-b1b0-bbbafe44f09b" (UID: "b6b82ae7-4822-4309-b1b0-bbbafe44f09b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:29:46.362446 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.362428 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-kube-api-access-kswms" (OuterVolumeSpecName: "kube-api-access-kswms") pod "b6b82ae7-4822-4309-b1b0-bbbafe44f09b" (UID: "b6b82ae7-4822-4309-b1b0-bbbafe44f09b"). InnerVolumeSpecName "kube-api-access-kswms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:29:46.460988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.460950 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-config\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:29:46.460988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.460984 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-oauth-config\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:29:46.460988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.460995 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-service-ca\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:29:46.461199 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.461003 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-oauth-serving-cert\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:29:46.461199 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.461012 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-console-serving-cert\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:29:46.461199 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.461020 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-trusted-ca-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:29:46.461199 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:46.461028 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kswms\" (UniqueName: \"kubernetes.io/projected/b6b82ae7-4822-4309-b1b0-bbbafe44f09b-kube-api-access-kswms\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:29:47.056946 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.056913 2567 generic.go:356] "Generic (PLEG): container finished" podID="b6b82ae7-4822-4309-b1b0-bbbafe44f09b" containerID="75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293" exitCode=0 Jun 05 21:29:47.057369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.056958 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd4555f47-rcdb5" Jun 05 21:29:47.057369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.056997 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd4555f47-rcdb5" event={"ID":"b6b82ae7-4822-4309-b1b0-bbbafe44f09b","Type":"ContainerDied","Data":"75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293"} Jun 05 21:29:47.057369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.057053 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd4555f47-rcdb5" event={"ID":"b6b82ae7-4822-4309-b1b0-bbbafe44f09b","Type":"ContainerDied","Data":"146962d4c847a0135a64abaee4c98e3852b36a2a042c8e66e1d3b88ac5eaecde"} Jun 05 21:29:47.057369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.057073 2567 scope.go:117] "RemoveContainer" containerID="75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293" Jun 05 21:29:47.066526 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.066509 2567 scope.go:117] "RemoveContainer" containerID="75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293" Jun 05 21:29:47.066781 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:29:47.066760 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293\": container with ID starting with 75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293 not found: ID does not exist" containerID="75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293" Jun 05 21:29:47.066829 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.066789 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293"} err="failed to get container status \"75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293\": rpc error: code = NotFound desc = could not find container \"75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293\": container with ID starting with 75bdfd8afe4874cdd445702915aaced8b8cf206754fc15f5afc71025785d2293 not found: ID does not exist" Jun 05 21:29:47.080510 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.080478 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd4555f47-rcdb5"] Jun 05 21:29:47.084687 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.084661 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dd4555f47-rcdb5"] Jun 05 21:29:47.437833 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:47.437756 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6b82ae7-4822-4309-b1b0-bbbafe44f09b" path="/var/lib/kubelet/pods/b6b82ae7-4822-4309-b1b0-bbbafe44f09b/volumes" Jun 05 21:29:51.580261 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:51.580229 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:51.674728 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:51.674686 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:29:52.247474 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.247436 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc"] Jun 05 21:29:52.247862 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.247844 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b82ae7-4822-4309-b1b0-bbbafe44f09b" containerName="console" Jun 05 21:29:52.247949 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.247865 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b82ae7-4822-4309-b1b0-bbbafe44f09b" containerName="console" Jun 05 21:29:52.248007 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.247951 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6b82ae7-4822-4309-b1b0-bbbafe44f09b" containerName="console" Jun 05 21:29:52.250688 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.250665 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.253613 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.253591 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 21:29:52.253752 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.253731 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 21:29:52.253821 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.253758 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qx4hd\"" Jun 05 21:29:52.262323 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.262297 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc"] Jun 05 21:29:52.322037 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.322002 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sg9w\" (UniqueName: \"kubernetes.io/projected/a8e7249d-8790-40e3-8e00-2ed13ec967d9-kube-api-access-7sg9w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.322236 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.322079 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.322236 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.322106 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.423215 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.423158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.423215 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.423216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.423483 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.423289 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sg9w\" (UniqueName: \"kubernetes.io/projected/a8e7249d-8790-40e3-8e00-2ed13ec967d9-kube-api-access-7sg9w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.423671 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.423646 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.423719 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.423659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.431941 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.431921 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sg9w\" (UniqueName: \"kubernetes.io/projected/a8e7249d-8790-40e3-8e00-2ed13ec967d9-kube-api-access-7sg9w\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.560146 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.560055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:29:52.692296 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.692160 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc"] Jun 05 21:29:52.695044 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:29:52.695017 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e7249d_8790_40e3_8e00_2ed13ec967d9.slice/crio-e8981d693c119e65f90bf0e0006c1137220429cab0b1afbc3b2ceadc612d954e WatchSource:0}: Error finding container e8981d693c119e65f90bf0e0006c1137220429cab0b1afbc3b2ceadc612d954e: Status 404 returned error can't find the container with id e8981d693c119e65f90bf0e0006c1137220429cab0b1afbc3b2ceadc612d954e Jun 05 21:29:52.696900 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:52.696877 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:29:53.084033 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:53.083997 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" event={"ID":"a8e7249d-8790-40e3-8e00-2ed13ec967d9","Type":"ContainerStarted","Data":"e8981d693c119e65f90bf0e0006c1137220429cab0b1afbc3b2ceadc612d954e"} Jun 05 21:29:59.116251 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:59.116210 2567 generic.go:356] "Generic (PLEG): container finished" podID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerID="fa1370aaf0d6d2e9deb40471948785007bd3833bf4c830d8e21440d4478307c8" exitCode=0 Jun 05 21:29:59.116752 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:29:59.116277 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" event={"ID":"a8e7249d-8790-40e3-8e00-2ed13ec967d9","Type":"ContainerDied","Data":"fa1370aaf0d6d2e9deb40471948785007bd3833bf4c830d8e21440d4478307c8"} Jun 05 21:30:01.136098 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:01.136064 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" event={"ID":"a8e7249d-8790-40e3-8e00-2ed13ec967d9","Type":"ContainerStarted","Data":"a550bc58fd2894d71777991424292dac495f12d82b76170c39d7de7c539002c8"} Jun 05 21:30:02.142259 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:02.142219 2567 generic.go:356] "Generic (PLEG): container finished" podID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerID="a550bc58fd2894d71777991424292dac495f12d82b76170c39d7de7c539002c8" exitCode=0 Jun 05 21:30:02.142662 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:02.142313 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" event={"ID":"a8e7249d-8790-40e3-8e00-2ed13ec967d9","Type":"ContainerDied","Data":"a550bc58fd2894d71777991424292dac495f12d82b76170c39d7de7c539002c8"} Jun 05 21:30:11.189795 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:11.189709 2567 generic.go:356] "Generic (PLEG): container finished" podID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerID="29a0fc781a59d40a5ad9ded9117a9bf9c484e200e1336d038038d38d593a8251" exitCode=0 Jun 05 21:30:11.189795 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:11.189761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" event={"ID":"a8e7249d-8790-40e3-8e00-2ed13ec967d9","Type":"ContainerDied","Data":"29a0fc781a59d40a5ad9ded9117a9bf9c484e200e1336d038038d38d593a8251"} Jun 05 21:30:12.323131 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.323105 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:30:12.407693 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.407650 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-util\") pod \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " Jun 05 21:30:12.407878 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.407712 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sg9w\" (UniqueName: \"kubernetes.io/projected/a8e7249d-8790-40e3-8e00-2ed13ec967d9-kube-api-access-7sg9w\") pod \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " Jun 05 21:30:12.407878 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.407768 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-bundle\") pod \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\" (UID: \"a8e7249d-8790-40e3-8e00-2ed13ec967d9\") " Jun 05 21:30:12.408505 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.408472 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-bundle" (OuterVolumeSpecName: "bundle") pod "a8e7249d-8790-40e3-8e00-2ed13ec967d9" (UID: "a8e7249d-8790-40e3-8e00-2ed13ec967d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:30:12.409950 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.409916 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e7249d-8790-40e3-8e00-2ed13ec967d9-kube-api-access-7sg9w" (OuterVolumeSpecName: "kube-api-access-7sg9w") pod "a8e7249d-8790-40e3-8e00-2ed13ec967d9" (UID: "a8e7249d-8790-40e3-8e00-2ed13ec967d9"). InnerVolumeSpecName "kube-api-access-7sg9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:30:12.411686 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.411664 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-util" (OuterVolumeSpecName: "util") pod "a8e7249d-8790-40e3-8e00-2ed13ec967d9" (UID: "a8e7249d-8790-40e3-8e00-2ed13ec967d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:30:12.508801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.508771 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sg9w\" (UniqueName: \"kubernetes.io/projected/a8e7249d-8790-40e3-8e00-2ed13ec967d9-kube-api-access-7sg9w\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:30:12.508801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.508806 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:30:12.509007 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:12.508819 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8e7249d-8790-40e3-8e00-2ed13ec967d9-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:30:13.202185 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:13.202147 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" event={"ID":"a8e7249d-8790-40e3-8e00-2ed13ec967d9","Type":"ContainerDied","Data":"e8981d693c119e65f90bf0e0006c1137220429cab0b1afbc3b2ceadc612d954e"} Jun 05 21:30:13.202417 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:13.202192 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz54fc" Jun 05 21:30:13.202417 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:13.202228 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8981d693c119e65f90bf0e0006c1137220429cab0b1afbc3b2ceadc612d954e" Jun 05 21:30:18.240057 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:18.240023 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:18.965421 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:18.965312 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:19.170006 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:19.169974 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:20.238002 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.237966 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m"] Jun 05 21:30:20.238411 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.238277 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerName="extract" Jun 05 21:30:20.238411 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.238288 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerName="extract" Jun 05 21:30:20.238411 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.238303 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerName="util" Jun 05 21:30:20.238411 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.238308 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerName="util" Jun 05 21:30:20.238411 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.238343 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerName="pull" Jun 05 21:30:20.238411 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.238350 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerName="pull" Jun 05 21:30:20.238411 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.238401 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e7249d-8790-40e3-8e00-2ed13ec967d9" containerName="extract" Jun 05 21:30:20.241444 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.241424 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" Jun 05 21:30:20.244923 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.244904 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8hgrk\"" Jun 05 21:30:20.245481 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.245465 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:30:20.251122 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.251101 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 21:30:20.286448 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.286415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkkp8\" (UniqueName: \"kubernetes.io/projected/e779c9b8-8d25-45fa-940e-0350e3207a0a-kube-api-access-lkkp8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czj7m\" (UID: \"e779c9b8-8d25-45fa-940e-0350e3207a0a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" Jun 05 21:30:20.286626 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.286468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e779c9b8-8d25-45fa-940e-0350e3207a0a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czj7m\" (UID: \"e779c9b8-8d25-45fa-940e-0350e3207a0a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" Jun 05 21:30:20.315006 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.314965 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m"] Jun 05 21:30:20.387553 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.387498 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e779c9b8-8d25-45fa-940e-0350e3207a0a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czj7m\" (UID: \"e779c9b8-8d25-45fa-940e-0350e3207a0a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" Jun 05 21:30:20.387747 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.387601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkkp8\" (UniqueName: \"kubernetes.io/projected/e779c9b8-8d25-45fa-940e-0350e3207a0a-kube-api-access-lkkp8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czj7m\" (UID: \"e779c9b8-8d25-45fa-940e-0350e3207a0a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" Jun 05 21:30:20.387925 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.387905 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e779c9b8-8d25-45fa-940e-0350e3207a0a-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czj7m\" (UID: \"e779c9b8-8d25-45fa-940e-0350e3207a0a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" Jun 05 21:30:20.396892 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.396857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkkp8\" (UniqueName: \"kubernetes.io/projected/e779c9b8-8d25-45fa-940e-0350e3207a0a-kube-api-access-lkkp8\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czj7m\" (UID: \"e779c9b8-8d25-45fa-940e-0350e3207a0a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" Jun 05 21:30:20.551370 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.551317 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" Jun 05 21:30:20.692137 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:20.692107 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m"] Jun 05 21:30:20.694382 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:30:20.694349 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode779c9b8_8d25_45fa_940e_0350e3207a0a.slice/crio-4704008b69137b09ac0613adb0272c5188db9613cd231d4f1b42c3662388b4cc WatchSource:0}: Error finding container 4704008b69137b09ac0613adb0272c5188db9613cd231d4f1b42c3662388b4cc: Status 404 returned error can't find the container with id 4704008b69137b09ac0613adb0272c5188db9613cd231d4f1b42c3662388b4cc Jun 05 21:30:21.241566 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:21.241531 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" event={"ID":"e779c9b8-8d25-45fa-940e-0350e3207a0a","Type":"ContainerStarted","Data":"4704008b69137b09ac0613adb0272c5188db9613cd231d4f1b42c3662388b4cc"} Jun 05 21:30:21.856480 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:21.856444 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:21.967496 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:21.967460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:22.975543 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:22.975498 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:23.097319 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:23.097283 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:23.253980 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:23.253935 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" event={"ID":"e779c9b8-8d25-45fa-940e-0350e3207a0a","Type":"ContainerStarted","Data":"44d56fe200bbf3eca064b5fd14ca19a94002e3252782df067237815b29c60750"} Jun 05 21:30:23.278804 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:23.278752 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czj7m" podStartSLOduration=1.611821261 podStartE2EDuration="3.278735533s" totalImagesPullingTime="1.666914272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:30:23.27641655 +0000 UTC m=+708.344826450" watchObservedRunningTime="2026-06-05 21:30:23.278735533 +0000 UTC m=+708.347145512" Jun 05 21:30:23.646358 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:23.646220 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:23.741353 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:23.741291 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:24.369025 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.368985 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9"] Jun 05 21:30:24.372674 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.372655 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.376365 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.376344 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 21:30:24.377140 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.377124 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qx4hd\"" Jun 05 21:30:24.377187 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.377159 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 21:30:24.382254 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.382230 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9"] Jun 05 21:30:24.525121 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.525076 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpnzf\" (UniqueName: \"kubernetes.io/projected/4091962a-7200-4575-a1f5-2fc492bef735-kube-api-access-hpnzf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.525121 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.525124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.525373 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.525170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.626323 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.626214 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpnzf\" (UniqueName: \"kubernetes.io/projected/4091962a-7200-4575-a1f5-2fc492bef735-kube-api-access-hpnzf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.626323 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.626270 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.626582 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.626405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.626723 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.626704 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.626774 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.626747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.637981 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.637954 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpnzf\" (UniqueName: \"kubernetes.io/projected/4091962a-7200-4575-a1f5-2fc492bef735-kube-api-access-hpnzf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.681865 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.681821 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:24.820300 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:24.820264 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9"] Jun 05 21:30:24.823787 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:30:24.823759 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4091962a_7200_4575_a1f5_2fc492bef735.slice/crio-d6ae620563da930e5bd86d8ecffb97da0e8fa8f3167b7ed80afbe379573bfe85 WatchSource:0}: Error finding container d6ae620563da930e5bd86d8ecffb97da0e8fa8f3167b7ed80afbe379573bfe85: Status 404 returned error can't find the container with id d6ae620563da930e5bd86d8ecffb97da0e8fa8f3167b7ed80afbe379573bfe85 Jun 05 21:30:25.270670 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.270635 2567 generic.go:356] "Generic (PLEG): container finished" podID="4091962a-7200-4575-a1f5-2fc492bef735" containerID="82b4c1bb68f384507399616e0d9dc780e3656f90232433eb77e623dc370c0ccf" exitCode=0 Jun 05 21:30:25.270880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.270690 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" event={"ID":"4091962a-7200-4575-a1f5-2fc492bef735","Type":"ContainerDied","Data":"82b4c1bb68f384507399616e0d9dc780e3656f90232433eb77e623dc370c0ccf"} Jun 05 21:30:25.270880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.270761 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" event={"ID":"4091962a-7200-4575-a1f5-2fc492bef735","Type":"ContainerStarted","Data":"d6ae620563da930e5bd86d8ecffb97da0e8fa8f3167b7ed80afbe379573bfe85"} Jun 05 21:30:25.656419 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.656384 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w"] Jun 05 21:30:25.660006 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.659980 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:25.662652 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.662630 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 21:30:25.662787 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.662656 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-blps9\"" Jun 05 21:30:25.662787 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.662668 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 21:30:25.667838 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.667815 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w"] Jun 05 21:30:25.734410 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.734362 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb0292e9-69d0-4a28-97fe-0c0b47240cef-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rhz5w\" (UID: \"fb0292e9-69d0-4a28-97fe-0c0b47240cef\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:25.734586 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.734429 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrn2n\" (UniqueName: \"kubernetes.io/projected/fb0292e9-69d0-4a28-97fe-0c0b47240cef-kube-api-access-mrn2n\") pod \"cert-manager-webhook-7dc76cbb94-rhz5w\" (UID: \"fb0292e9-69d0-4a28-97fe-0c0b47240cef\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:25.835799 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.835761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb0292e9-69d0-4a28-97fe-0c0b47240cef-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rhz5w\" (UID: \"fb0292e9-69d0-4a28-97fe-0c0b47240cef\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:25.835987 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.835814 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrn2n\" (UniqueName: \"kubernetes.io/projected/fb0292e9-69d0-4a28-97fe-0c0b47240cef-kube-api-access-mrn2n\") pod \"cert-manager-webhook-7dc76cbb94-rhz5w\" (UID: \"fb0292e9-69d0-4a28-97fe-0c0b47240cef\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:25.845007 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.844981 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb0292e9-69d0-4a28-97fe-0c0b47240cef-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-rhz5w\" (UID: \"fb0292e9-69d0-4a28-97fe-0c0b47240cef\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:25.845280 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.845251 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrn2n\" (UniqueName: \"kubernetes.io/projected/fb0292e9-69d0-4a28-97fe-0c0b47240cef-kube-api-access-mrn2n\") pod \"cert-manager-webhook-7dc76cbb94-rhz5w\" (UID: \"fb0292e9-69d0-4a28-97fe-0c0b47240cef\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:25.980392 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:25.980289 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:26.135684 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:26.135653 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w"] Jun 05 21:30:26.137203 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:30:26.137173 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb0292e9_69d0_4a28_97fe_0c0b47240cef.slice/crio-8d559333b518f11589afbc413b17354a9a4512fab6f09311a5aea394ac051a75 WatchSource:0}: Error finding container 8d559333b518f11589afbc413b17354a9a4512fab6f09311a5aea394ac051a75: Status 404 returned error can't find the container with id 8d559333b518f11589afbc413b17354a9a4512fab6f09311a5aea394ac051a75 Jun 05 21:30:26.278400 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:26.278362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" event={"ID":"fb0292e9-69d0-4a28-97fe-0c0b47240cef","Type":"ContainerStarted","Data":"8d559333b518f11589afbc413b17354a9a4512fab6f09311a5aea394ac051a75"} Jun 05 21:30:26.299776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:26.299740 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:26.868160 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:26.868124 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:27.286344 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:27.286277 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" event={"ID":"4091962a-7200-4575-a1f5-2fc492bef735","Type":"ContainerStarted","Data":"66ef3b56c2daca05badd25cf34dc68bfae82dc5faeeaafa42d2db18576a41127"} Jun 05 21:30:28.294593 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:28.294554 2567 generic.go:356] "Generic (PLEG): container finished" podID="4091962a-7200-4575-a1f5-2fc492bef735" containerID="66ef3b56c2daca05badd25cf34dc68bfae82dc5faeeaafa42d2db18576a41127" exitCode=0 Jun 05 21:30:28.295062 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:28.294613 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" event={"ID":"4091962a-7200-4575-a1f5-2fc492bef735","Type":"ContainerDied","Data":"66ef3b56c2daca05badd25cf34dc68bfae82dc5faeeaafa42d2db18576a41127"} Jun 05 21:30:28.502749 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:28.502719 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:28.585974 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:28.585887 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:29.301146 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:29.301044 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" event={"ID":"fb0292e9-69d0-4a28-97fe-0c0b47240cef","Type":"ContainerStarted","Data":"d4041fc64a9f790669a4e1a990ba27f8c62328feba74e650c76118ee905b3a67"} Jun 05 21:30:29.301600 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:29.301206 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:29.303250 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:29.303223 2567 generic.go:356] "Generic (PLEG): container finished" podID="4091962a-7200-4575-a1f5-2fc492bef735" containerID="611b8309ea0908acfc3aff72ddcfe8789e0537b84689f432cc79d7f3b139150f" exitCode=0 Jun 05 21:30:29.303395 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:29.303274 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" event={"ID":"4091962a-7200-4575-a1f5-2fc492bef735","Type":"ContainerDied","Data":"611b8309ea0908acfc3aff72ddcfe8789e0537b84689f432cc79d7f3b139150f"} Jun 05 21:30:29.324145 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:29.321836 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" podStartSLOduration=1.404071522 podStartE2EDuration="4.321814013s" totalImagesPullingTime="2.917742491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:30:29.318575064 +0000 UTC m=+714.386984964" watchObservedRunningTime="2026-06-05 21:30:29.321814013 +0000 UTC m=+714.390223914" Jun 05 21:30:30.441892 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.441855 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:30.580253 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.580146 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpnzf\" (UniqueName: \"kubernetes.io/projected/4091962a-7200-4575-a1f5-2fc492bef735-kube-api-access-hpnzf\") pod \"4091962a-7200-4575-a1f5-2fc492bef735\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " Jun 05 21:30:30.580253 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.580219 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-util\") pod \"4091962a-7200-4575-a1f5-2fc492bef735\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " Jun 05 21:30:30.580532 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.580316 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-bundle\") pod \"4091962a-7200-4575-a1f5-2fc492bef735\" (UID: \"4091962a-7200-4575-a1f5-2fc492bef735\") " Jun 05 21:30:30.580692 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.580669 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-bundle" (OuterVolumeSpecName: "bundle") pod "4091962a-7200-4575-a1f5-2fc492bef735" (UID: "4091962a-7200-4575-a1f5-2fc492bef735"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:30:30.582291 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.582257 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4091962a-7200-4575-a1f5-2fc492bef735-kube-api-access-hpnzf" (OuterVolumeSpecName: "kube-api-access-hpnzf") pod "4091962a-7200-4575-a1f5-2fc492bef735" (UID: "4091962a-7200-4575-a1f5-2fc492bef735"). InnerVolumeSpecName "kube-api-access-hpnzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:30:30.584218 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.584189 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-util" (OuterVolumeSpecName: "util") pod "4091962a-7200-4575-a1f5-2fc492bef735" (UID: "4091962a-7200-4575-a1f5-2fc492bef735"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:30:30.681229 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.681182 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:30:30.681229 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.681225 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpnzf\" (UniqueName: \"kubernetes.io/projected/4091962a-7200-4575-a1f5-2fc492bef735-kube-api-access-hpnzf\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:30:30.681229 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.681236 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4091962a-7200-4575-a1f5-2fc492bef735-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:30:30.878182 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.878094 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:30.936602 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:30.936570 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:31.314005 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:31.313976 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" Jun 05 21:30:31.314152 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:31.313975 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftffw9" event={"ID":"4091962a-7200-4575-a1f5-2fc492bef735","Type":"ContainerDied","Data":"d6ae620563da930e5bd86d8ecffb97da0e8fa8f3167b7ed80afbe379573bfe85"} Jun 05 21:30:31.314152 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:31.314093 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6ae620563da930e5bd86d8ecffb97da0e8fa8f3167b7ed80afbe379573bfe85" Jun 05 21:30:34.697107 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:34.697073 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:35.309928 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:35.309900 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-rhz5w" Jun 05 21:30:35.747431 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:35.747398 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:35.848135 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:35.848100 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:37.589214 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.589180 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6"] Jun 05 21:30:37.589619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.589542 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4091962a-7200-4575-a1f5-2fc492bef735" containerName="extract" Jun 05 21:30:37.589619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.589553 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4091962a-7200-4575-a1f5-2fc492bef735" containerName="extract" Jun 05 21:30:37.589619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.589579 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4091962a-7200-4575-a1f5-2fc492bef735" containerName="pull" Jun 05 21:30:37.589619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.589584 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4091962a-7200-4575-a1f5-2fc492bef735" containerName="pull" Jun 05 21:30:37.589619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.589591 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4091962a-7200-4575-a1f5-2fc492bef735" containerName="util" Jun 05 21:30:37.589619 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.589597 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4091962a-7200-4575-a1f5-2fc492bef735" containerName="util" Jun 05 21:30:37.589805 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.589645 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4091962a-7200-4575-a1f5-2fc492bef735" containerName="extract" Jun 05 21:30:37.592840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.592821 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" Jun 05 21:30:37.595276 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.595245 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 21:30:37.595276 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.595249 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:30:37.595451 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.595313 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cx4f2\"" Jun 05 21:30:37.601191 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.601166 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6"] Jun 05 21:30:37.746443 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.746403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgrx7\" (UniqueName: \"kubernetes.io/projected/9f2391e2-8b1f-4d6c-9907-39af70c16015-kube-api-access-pgrx7\") pod \"openshift-lws-operator-fd8ccff4c-hw7s6\" (UID: \"9f2391e2-8b1f-4d6c-9907-39af70c16015\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" Jun 05 21:30:37.746443 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.746444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f2391e2-8b1f-4d6c-9907-39af70c16015-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hw7s6\" (UID: \"9f2391e2-8b1f-4d6c-9907-39af70c16015\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" Jun 05 21:30:37.847478 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.847388 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgrx7\" (UniqueName: \"kubernetes.io/projected/9f2391e2-8b1f-4d6c-9907-39af70c16015-kube-api-access-pgrx7\") pod \"openshift-lws-operator-fd8ccff4c-hw7s6\" (UID: \"9f2391e2-8b1f-4d6c-9907-39af70c16015\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" Jun 05 21:30:37.847478 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.847431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f2391e2-8b1f-4d6c-9907-39af70c16015-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hw7s6\" (UID: \"9f2391e2-8b1f-4d6c-9907-39af70c16015\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" Jun 05 21:30:37.847846 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.847824 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f2391e2-8b1f-4d6c-9907-39af70c16015-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hw7s6\" (UID: \"9f2391e2-8b1f-4d6c-9907-39af70c16015\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" Jun 05 21:30:37.858371 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.858322 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgrx7\" (UniqueName: \"kubernetes.io/projected/9f2391e2-8b1f-4d6c-9907-39af70c16015-kube-api-access-pgrx7\") pod \"openshift-lws-operator-fd8ccff4c-hw7s6\" (UID: \"9f2391e2-8b1f-4d6c-9907-39af70c16015\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" Jun 05 21:30:37.902476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:37.902436 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" Jun 05 21:30:38.039026 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:38.038998 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6"] Jun 05 21:30:38.041041 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:30:38.041018 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f2391e2_8b1f_4d6c_9907_39af70c16015.slice/crio-3ba6c5f2d5a379be168bfaa1c89eb57fc802e29d56cf11a4f6e423d952a8ffd8 WatchSource:0}: Error finding container 3ba6c5f2d5a379be168bfaa1c89eb57fc802e29d56cf11a4f6e423d952a8ffd8: Status 404 returned error can't find the container with id 3ba6c5f2d5a379be168bfaa1c89eb57fc802e29d56cf11a4f6e423d952a8ffd8 Jun 05 21:30:38.344708 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:38.344669 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" event={"ID":"9f2391e2-8b1f-4d6c-9907-39af70c16015","Type":"ContainerStarted","Data":"3ba6c5f2d5a379be168bfaa1c89eb57fc802e29d56cf11a4f6e423d952a8ffd8"} Jun 05 21:30:41.363834 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:41.363797 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" event={"ID":"9f2391e2-8b1f-4d6c-9907-39af70c16015","Type":"ContainerStarted","Data":"7e51f8a50bff9d3df2c6e80b3e835a882817accea78b03f5ed41c2f6b2f8279e"} Jun 05 21:30:41.380077 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:41.380020 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hw7s6" podStartSLOduration=2.06457849 podStartE2EDuration="4.380003805s" totalImagesPullingTime="2.315425315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:30:41.379323518 +0000 UTC m=+726.447733418" watchObservedRunningTime="2026-06-05 21:30:41.380003805 +0000 UTC m=+726.448413704" Jun 05 21:30:42.171970 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:42.171931 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:42.272638 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:42.272605 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:43.751098 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.751057 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7"] Jun 05 21:30:43.754496 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.754472 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:43.757231 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.757208 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qx4hd\"" Jun 05 21:30:43.757383 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.757217 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 21:30:43.757383 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.757261 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 21:30:43.761978 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.761831 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7"] Jun 05 21:30:43.799255 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.799219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd9mw\" (UniqueName: \"kubernetes.io/projected/2489b491-d272-4615-82f9-4c690162c07b-kube-api-access-jd9mw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:43.799477 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.799272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:43.799477 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.799290 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:43.899799 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.899757 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd9mw\" (UniqueName: \"kubernetes.io/projected/2489b491-d272-4615-82f9-4c690162c07b-kube-api-access-jd9mw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:43.900014 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.899825 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:43.900014 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.899845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:43.900231 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.900211 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:43.900277 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.900232 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:43.908942 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:43.908912 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd9mw\" (UniqueName: \"kubernetes.io/projected/2489b491-d272-4615-82f9-4c690162c07b-kube-api-access-jd9mw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:44.064835 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:44.064739 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:44.188103 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:44.188070 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:44.195530 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:44.195500 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7"] Jun 05 21:30:44.198280 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:30:44.198254 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2489b491_d272_4615_82f9_4c690162c07b.slice/crio-c1828656081d756a199c118bac6d18ddf3b6945bd2343372f372837a53dd7728 WatchSource:0}: Error finding container c1828656081d756a199c118bac6d18ddf3b6945bd2343372f372837a53dd7728: Status 404 returned error can't find the container with id c1828656081d756a199c118bac6d18ddf3b6945bd2343372f372837a53dd7728 Jun 05 21:30:44.379729 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:44.379635 2567 generic.go:356] "Generic (PLEG): container finished" podID="2489b491-d272-4615-82f9-4c690162c07b" containerID="b72e26a9827ae2b033e6a879eb45fde8af8b3c1c5109c2e228374ba98608c6b5" exitCode=0 Jun 05 21:30:44.379891 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:44.379729 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" event={"ID":"2489b491-d272-4615-82f9-4c690162c07b","Type":"ContainerDied","Data":"b72e26a9827ae2b033e6a879eb45fde8af8b3c1c5109c2e228374ba98608c6b5"} Jun 05 21:30:44.379891 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:44.379784 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" event={"ID":"2489b491-d272-4615-82f9-4c690162c07b","Type":"ContainerStarted","Data":"c1828656081d756a199c118bac6d18ddf3b6945bd2343372f372837a53dd7728"} Jun 05 21:30:45.385777 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:45.385745 2567 generic.go:356] "Generic (PLEG): container finished" podID="2489b491-d272-4615-82f9-4c690162c07b" containerID="9a176f64f16ed6fd42e000cdf5c3dc0b8c6367525ff3b979fea24807d0c1c88a" exitCode=0 Jun 05 21:30:45.386263 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:45.385816 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" event={"ID":"2489b491-d272-4615-82f9-4c690162c07b","Type":"ContainerDied","Data":"9a176f64f16ed6fd42e000cdf5c3dc0b8c6367525ff3b979fea24807d0c1c88a"} Jun 05 21:30:46.392835 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:46.392802 2567 generic.go:356] "Generic (PLEG): container finished" podID="2489b491-d272-4615-82f9-4c690162c07b" containerID="a0995b3ae41d69ea2e355c30a1bfa94f433780f0d3c9e70cf41671600e8a1b88" exitCode=0 Jun 05 21:30:46.393213 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:46.392862 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" event={"ID":"2489b491-d272-4615-82f9-4c690162c07b","Type":"ContainerDied","Data":"a0995b3ae41d69ea2e355c30a1bfa94f433780f0d3c9e70cf41671600e8a1b88"} Jun 05 21:30:47.528655 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.528625 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:47.629924 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.629874 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-util\") pod \"2489b491-d272-4615-82f9-4c690162c07b\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " Jun 05 21:30:47.630121 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.629952 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd9mw\" (UniqueName: \"kubernetes.io/projected/2489b491-d272-4615-82f9-4c690162c07b-kube-api-access-jd9mw\") pod \"2489b491-d272-4615-82f9-4c690162c07b\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " Jun 05 21:30:47.630121 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.630028 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-bundle\") pod \"2489b491-d272-4615-82f9-4c690162c07b\" (UID: \"2489b491-d272-4615-82f9-4c690162c07b\") " Jun 05 21:30:47.630756 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.630722 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-bundle" (OuterVolumeSpecName: "bundle") pod "2489b491-d272-4615-82f9-4c690162c07b" (UID: "2489b491-d272-4615-82f9-4c690162c07b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:30:47.632060 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.632037 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2489b491-d272-4615-82f9-4c690162c07b-kube-api-access-jd9mw" (OuterVolumeSpecName: "kube-api-access-jd9mw") pod "2489b491-d272-4615-82f9-4c690162c07b" (UID: "2489b491-d272-4615-82f9-4c690162c07b"). InnerVolumeSpecName "kube-api-access-jd9mw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:30:47.638122 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.638096 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-util" (OuterVolumeSpecName: "util") pod "2489b491-d272-4615-82f9-4c690162c07b" (UID: "2489b491-d272-4615-82f9-4c690162c07b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:30:47.730994 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.730911 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:30:47.730994 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.730940 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd9mw\" (UniqueName: \"kubernetes.io/projected/2489b491-d272-4615-82f9-4c690162c07b-kube-api-access-jd9mw\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:30:47.730994 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:47.730976 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2489b491-d272-4615-82f9-4c690162c07b-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:30:48.404910 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:48.404882 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" Jun 05 21:30:48.404910 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:48.404881 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbdbg7" event={"ID":"2489b491-d272-4615-82f9-4c690162c07b","Type":"ContainerDied","Data":"c1828656081d756a199c118bac6d18ddf3b6945bd2343372f372837a53dd7728"} Jun 05 21:30:48.405162 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:48.404936 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1828656081d756a199c118bac6d18ddf3b6945bd2343372f372837a53dd7728" Jun 05 21:30:56.701438 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:56.701404 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:56.792666 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:56.792636 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:57.320629 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.320591 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:57.523467 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.523427 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:57.627103 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.627019 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:57.676162 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.676130 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8"] Jun 05 21:30:57.676485 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.676473 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2489b491-d272-4615-82f9-4c690162c07b" containerName="util" Jun 05 21:30:57.676537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.676487 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2489b491-d272-4615-82f9-4c690162c07b" containerName="util" Jun 05 21:30:57.676537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.676506 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2489b491-d272-4615-82f9-4c690162c07b" containerName="extract" Jun 05 21:30:57.676537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.676511 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2489b491-d272-4615-82f9-4c690162c07b" containerName="extract" Jun 05 21:30:57.676537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.676520 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2489b491-d272-4615-82f9-4c690162c07b" containerName="pull" Jun 05 21:30:57.676537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.676525 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2489b491-d272-4615-82f9-4c690162c07b" containerName="pull" Jun 05 21:30:57.676992 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.676585 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2489b491-d272-4615-82f9-4c690162c07b" containerName="extract" Jun 05 21:30:57.679944 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.679925 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.682789 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.682764 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 21:30:57.682789 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.682791 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 21:30:57.682970 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.682804 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 21:30:57.682970 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.682800 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 21:30:57.683103 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.683090 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9chch\"" Jun 05 21:30:57.695841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.695819 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8"] Jun 05 21:30:57.718749 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.718705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5e758c28-18c4-43d0-a05a-ff8a61eedc91-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.719127 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.718776 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e758c28-18c4-43d0-a05a-ff8a61eedc91-webhook-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.719127 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.718804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcm5p\" (UniqueName: \"kubernetes.io/projected/5e758c28-18c4-43d0-a05a-ff8a61eedc91-kube-api-access-bcm5p\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.719127 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.718838 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e758c28-18c4-43d0-a05a-ff8a61eedc91-tmp\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.719127 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.718865 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5e758c28-18c4-43d0-a05a-ff8a61eedc91-manifests\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.805162 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.805129 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:57.819968 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.819928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5e758c28-18c4-43d0-a05a-ff8a61eedc91-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.820144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.819987 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e758c28-18c4-43d0-a05a-ff8a61eedc91-webhook-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.820144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.820014 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcm5p\" (UniqueName: \"kubernetes.io/projected/5e758c28-18c4-43d0-a05a-ff8a61eedc91-kube-api-access-bcm5p\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.820144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.820038 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e758c28-18c4-43d0-a05a-ff8a61eedc91-tmp\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.820144 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.820057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5e758c28-18c4-43d0-a05a-ff8a61eedc91-manifests\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.820534 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.820506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5e758c28-18c4-43d0-a05a-ff8a61eedc91-manifests\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.822190 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.822167 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e758c28-18c4-43d0-a05a-ff8a61eedc91-tmp\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.822455 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.822438 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5e758c28-18c4-43d0-a05a-ff8a61eedc91-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.822564 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.822545 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e758c28-18c4-43d0-a05a-ff8a61eedc91-webhook-cert\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.830296 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.830262 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcm5p\" (UniqueName: \"kubernetes.io/projected/5e758c28-18c4-43d0-a05a-ff8a61eedc91-kube-api-access-bcm5p\") pod \"opendatahub-operator-controller-manager-5df7699bf6-ph6b8\" (UID: \"5e758c28-18c4-43d0-a05a-ff8a61eedc91\") " pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:57.933676 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.933592 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:57.990280 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:57.990242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:30:58.029379 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:58.029288 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:58.106048 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:58.106019 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:58.124576 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:58.124553 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8"] Jun 05 21:30:58.127357 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:30:58.127320 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e758c28_18c4_43d0_a05a_ff8a61eedc91.slice/crio-3128d97de3ddb50849445e5c6253f4041f923f81ad107afb751dc2644241832c WatchSource:0}: Error finding container 3128d97de3ddb50849445e5c6253f4041f923f81ad107afb751dc2644241832c: Status 404 returned error can't find the container with id 3128d97de3ddb50849445e5c6253f4041f923f81ad107afb751dc2644241832c Jun 05 21:30:58.182807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:58.182763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:58.453251 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:30:58.453217 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" event={"ID":"5e758c28-18c4-43d0-a05a-ff8a61eedc91","Type":"ContainerStarted","Data":"3128d97de3ddb50849445e5c6253f4041f923f81ad107afb751dc2644241832c"} Jun 05 21:31:01.472916 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:01.472877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" event={"ID":"5e758c28-18c4-43d0-a05a-ff8a61eedc91","Type":"ContainerStarted","Data":"b2506c015fd66332dafd2854fb691d9610bc2eacce995ce86087ba44f7074fa3"} Jun 05 21:31:02.482036 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:02.482000 2567 generic.go:356] "Generic (PLEG): container finished" podID="5e758c28-18c4-43d0-a05a-ff8a61eedc91" containerID="b2506c015fd66332dafd2854fb691d9610bc2eacce995ce86087ba44f7074fa3" exitCode=0 Jun 05 21:31:02.482509 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:02.482083 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" event={"ID":"5e758c28-18c4-43d0-a05a-ff8a61eedc91","Type":"ContainerDied","Data":"b2506c015fd66332dafd2854fb691d9610bc2eacce995ce86087ba44f7074fa3"} Jun 05 21:31:03.488778 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:03.488733 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" event={"ID":"5e758c28-18c4-43d0-a05a-ff8a61eedc91","Type":"ContainerStarted","Data":"a33f3a26616171aadd7f3e47b221e7768bcec46a8308ce65a9e151adab4ce35c"} Jun 05 21:31:03.489192 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:03.488935 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:31:03.511246 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:03.511191 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" podStartSLOduration=2.469746423 podStartE2EDuration="6.511173673s" totalImagesPullingTime="3.131307292s" totalInitContainerRuntime="910.119958ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:30:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:03.508685429 +0000 UTC m=+748.577095331" watchObservedRunningTime="2026-06-05 21:31:03.511173673 +0000 UTC m=+748.579583572" Jun 05 21:31:06.531564 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:06.531527 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:06.627907 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:06.627856 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:14.497345 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:14.497306 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5df7699bf6-ph6b8" Jun 05 21:31:16.457019 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:16.456981 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:16.773298 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:16.773262 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:16.904737 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:16.904693 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:17.016197 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.016150 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:17.106891 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.106799 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh"] Jun 05 21:31:17.111260 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.111238 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.114668 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.114241 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 21:31:17.114668 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.114512 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qx4hd\"" Jun 05 21:31:17.115287 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.115132 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 21:31:17.162393 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.162359 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh"] Jun 05 21:31:17.169507 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.169474 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc"] Jun 05 21:31:17.173632 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.173613 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.178095 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.178069 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 21:31:17.178559 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.178535 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nxvnk\"" Jun 05 21:31:17.182617 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.182595 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 21:31:17.193267 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.193241 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc"] Jun 05 21:31:17.209572 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.209539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.209749 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.209594 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7ql\" (UniqueName: \"kubernetes.io/projected/c86db0eb-ab79-403d-baf4-a37ebb4db888-kube-api-access-tc7ql\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.209749 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.209626 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.310279 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.310243 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.310489 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.310291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-tmp\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.310489 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.310312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-tls-certs\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.310489 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.310374 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7ql\" (UniqueName: \"kubernetes.io/projected/c86db0eb-ab79-403d-baf4-a37ebb4db888-kube-api-access-tc7ql\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.310489 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.310420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kd7c\" (UniqueName: \"kubernetes.io/projected/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-kube-api-access-4kd7c\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.310489 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.310478 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.310705 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.310686 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.310761 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.310742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.334374 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.334344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7ql\" (UniqueName: \"kubernetes.io/projected/c86db0eb-ab79-403d-baf4-a37ebb4db888-kube-api-access-tc7ql\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.411753 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.411652 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-tmp\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.411753 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.411692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-tls-certs\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.411753 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.411728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kd7c\" (UniqueName: \"kubernetes.io/projected/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-kube-api-access-4kd7c\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.412077 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:31:17.411860 2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 05 21:31:17.412077 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:31:17.411966 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-tls-certs podName:bab694ca-2dc0-4552-8389-88b5ce6bfdb5 nodeName:}" failed. No retries permitted until 2026-06-05 21:31:17.911915743 +0000 UTC m=+762.980325620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-tls-certs") pod "kube-auth-proxy-7bd79689b-q7tmc" (UID: "bab694ca-2dc0-4552-8389-88b5ce6bfdb5") : secret "kube-auth-proxy-tls" not found Jun 05 21:31:17.413998 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.413977 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-tmp\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.422423 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.422388 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:17.439430 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.439401 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kd7c\" (UniqueName: \"kubernetes.io/projected/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-kube-api-access-4kd7c\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.529128 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.529094 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-p4whr"] Jun 05 21:31:17.537573 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.537547 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:17.540933 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.540779 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-crj8q\"" Jun 05 21:31:17.543620 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.541435 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 05 21:31:17.597071 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.597035 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:17.612695 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.612649 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-p4whr"] Jun 05 21:31:17.614096 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.614073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bc3e292-68a6-4178-a98f-1d27915b2251-cert\") pod \"odh-model-controller-6dc94f689f-p4whr\" (UID: \"6bc3e292-68a6-4178-a98f-1d27915b2251\") " pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:17.614235 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.614111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5tbv\" (UniqueName: \"kubernetes.io/projected/6bc3e292-68a6-4178-a98f-1d27915b2251-kube-api-access-d5tbv\") pod \"odh-model-controller-6dc94f689f-p4whr\" (UID: \"6bc3e292-68a6-4178-a98f-1d27915b2251\") " pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:17.620477 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.620404 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh"] Jun 05 21:31:17.623198 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:17.623171 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86db0eb_ab79_403d_baf4_a37ebb4db888.slice/crio-9e51eb37ead0c3feeb197183ca5f566eec9c9ddd0af526c9686560465e1a794f WatchSource:0}: Error finding container 9e51eb37ead0c3feeb197183ca5f566eec9c9ddd0af526c9686560465e1a794f: Status 404 returned error can't find the container with id 9e51eb37ead0c3feeb197183ca5f566eec9c9ddd0af526c9686560465e1a794f Jun 05 21:31:17.704990 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.704961 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:17.715079 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.715045 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bc3e292-68a6-4178-a98f-1d27915b2251-cert\") pod \"odh-model-controller-6dc94f689f-p4whr\" (UID: \"6bc3e292-68a6-4178-a98f-1d27915b2251\") " pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:17.715265 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.715101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5tbv\" (UniqueName: \"kubernetes.io/projected/6bc3e292-68a6-4178-a98f-1d27915b2251-kube-api-access-d5tbv\") pod \"odh-model-controller-6dc94f689f-p4whr\" (UID: \"6bc3e292-68a6-4178-a98f-1d27915b2251\") " pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:17.715265 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:31:17.715199 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 05 21:31:17.715410 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:31:17.715267 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bc3e292-68a6-4178-a98f-1d27915b2251-cert podName:6bc3e292-68a6-4178-a98f-1d27915b2251 nodeName:}" failed. No retries permitted until 2026-06-05 21:31:18.215249504 +0000 UTC m=+763.283659381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6bc3e292-68a6-4178-a98f-1d27915b2251-cert") pod "odh-model-controller-6dc94f689f-p4whr" (UID: "6bc3e292-68a6-4178-a98f-1d27915b2251") : secret "odh-model-controller-webhook-cert" not found Jun 05 21:31:17.747664 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.747624 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5tbv\" (UniqueName: \"kubernetes.io/projected/6bc3e292-68a6-4178-a98f-1d27915b2251-kube-api-access-d5tbv\") pod \"odh-model-controller-6dc94f689f-p4whr\" (UID: \"6bc3e292-68a6-4178-a98f-1d27915b2251\") " pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:17.811027 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.810979 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:17.901187 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.901143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:17.916473 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.916434 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-tls-certs\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:17.918909 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:17.918888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab694ca-2dc0-4552-8389-88b5ce6bfdb5-tls-certs\") pod \"kube-auth-proxy-7bd79689b-q7tmc\" (UID: \"bab694ca-2dc0-4552-8389-88b5ce6bfdb5\") " pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:18.085116 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.085079 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" Jun 05 21:31:18.220734 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.220685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bc3e292-68a6-4178-a98f-1d27915b2251-cert\") pod \"odh-model-controller-6dc94f689f-p4whr\" (UID: \"6bc3e292-68a6-4178-a98f-1d27915b2251\") " pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:18.221245 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.221172 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc"] Jun 05 21:31:18.223039 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.223005 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bc3e292-68a6-4178-a98f-1d27915b2251-cert\") pod \"odh-model-controller-6dc94f689f-p4whr\" (UID: \"6bc3e292-68a6-4178-a98f-1d27915b2251\") " pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:18.223446 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:18.223426 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab694ca_2dc0_4552_8389_88b5ce6bfdb5.slice/crio-e19ef1b4b8f89ef5d7ade724c7b75048c5bb1f126d0080515217803d2c20b35b WatchSource:0}: Error finding container e19ef1b4b8f89ef5d7ade724c7b75048c5bb1f126d0080515217803d2c20b35b: Status 404 returned error can't find the container with id e19ef1b4b8f89ef5d7ade724c7b75048c5bb1f126d0080515217803d2c20b35b Jun 05 21:31:18.300439 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.300399 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-h5v5r"] Jun 05 21:31:18.305129 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.305107 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:18.308401 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.308379 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 05 21:31:18.308487 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.308418 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8qdwk\"" Jun 05 21:31:18.326583 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.326550 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-h5v5r"] Jun 05 21:31:18.346445 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.346356 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:18.422432 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.422401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07bdc101-34f9-43b0-824a-7d5a5e883550-tls-certs\") pod \"model-serving-api-5dd488fc48-h5v5r\" (UID: \"07bdc101-34f9-43b0-824a-7d5a5e883550\") " pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:18.422643 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.422537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24fh4\" (UniqueName: \"kubernetes.io/projected/07bdc101-34f9-43b0-824a-7d5a5e883550-kube-api-access-24fh4\") pod \"model-serving-api-5dd488fc48-h5v5r\" (UID: \"07bdc101-34f9-43b0-824a-7d5a5e883550\") " pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:18.453588 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.453554 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:18.523864 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.523833 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07bdc101-34f9-43b0-824a-7d5a5e883550-tls-certs\") pod \"model-serving-api-5dd488fc48-h5v5r\" (UID: \"07bdc101-34f9-43b0-824a-7d5a5e883550\") " pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:18.524019 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.523942 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24fh4\" (UniqueName: \"kubernetes.io/projected/07bdc101-34f9-43b0-824a-7d5a5e883550-kube-api-access-24fh4\") pod \"model-serving-api-5dd488fc48-h5v5r\" (UID: \"07bdc101-34f9-43b0-824a-7d5a5e883550\") " pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:18.526436 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.526412 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07bdc101-34f9-43b0-824a-7d5a5e883550-tls-certs\") pod \"model-serving-api-5dd488fc48-h5v5r\" (UID: \"07bdc101-34f9-43b0-824a-7d5a5e883550\") " pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:18.534085 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.534057 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24fh4\" (UniqueName: \"kubernetes.io/projected/07bdc101-34f9-43b0-824a-7d5a5e883550-kube-api-access-24fh4\") pod \"model-serving-api-5dd488fc48-h5v5r\" (UID: \"07bdc101-34f9-43b0-824a-7d5a5e883550\") " pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:18.562268 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.562232 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:18.574874 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.574840 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" event={"ID":"bab694ca-2dc0-4552-8389-88b5ce6bfdb5","Type":"ContainerStarted","Data":"e19ef1b4b8f89ef5d7ade724c7b75048c5bb1f126d0080515217803d2c20b35b"} Jun 05 21:31:18.576255 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.576227 2567 generic.go:356] "Generic (PLEG): container finished" podID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerID="3861f9be937333aca6c6f60a671d36fd5b417a13927efee2f7c67bf0d7baab54" exitCode=0 Jun 05 21:31:18.576410 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.576304 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" event={"ID":"c86db0eb-ab79-403d-baf4-a37ebb4db888","Type":"ContainerDied","Data":"3861f9be937333aca6c6f60a671d36fd5b417a13927efee2f7c67bf0d7baab54"} Jun 05 21:31:18.576410 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.576373 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" event={"ID":"c86db0eb-ab79-403d-baf4-a37ebb4db888","Type":"ContainerStarted","Data":"9e51eb37ead0c3feeb197183ca5f566eec9c9ddd0af526c9686560465e1a794f"} Jun 05 21:31:18.596199 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.596164 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-p4whr"] Jun 05 21:31:18.599543 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:18.599515 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc3e292_68a6_4178_a98f_1d27915b2251.slice/crio-e18e6f7a15c056a256ba4414ebc9a146d27443262bcd7a0b7dbf280a275774c2 WatchSource:0}: Error finding container e18e6f7a15c056a256ba4414ebc9a146d27443262bcd7a0b7dbf280a275774c2: Status 404 returned error can't find the container with id e18e6f7a15c056a256ba4414ebc9a146d27443262bcd7a0b7dbf280a275774c2 Jun 05 21:31:18.615748 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.615705 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:18.758808 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:18.758778 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-h5v5r"] Jun 05 21:31:18.760881 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:18.760848 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bdc101_34f9_43b0_824a_7d5a5e883550.slice/crio-333a59eac2d656eb0c1ff718289380d561679a60bc30f2eff343f6dc89bd3d79 WatchSource:0}: Error finding container 333a59eac2d656eb0c1ff718289380d561679a60bc30f2eff343f6dc89bd3d79: Status 404 returned error can't find the container with id 333a59eac2d656eb0c1ff718289380d561679a60bc30f2eff343f6dc89bd3d79 Jun 05 21:31:19.596878 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:19.596781 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" event={"ID":"07bdc101-34f9-43b0-824a-7d5a5e883550","Type":"ContainerStarted","Data":"333a59eac2d656eb0c1ff718289380d561679a60bc30f2eff343f6dc89bd3d79"} Jun 05 21:31:19.600485 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:19.600412 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" event={"ID":"6bc3e292-68a6-4178-a98f-1d27915b2251","Type":"ContainerStarted","Data":"e18e6f7a15c056a256ba4414ebc9a146d27443262bcd7a0b7dbf280a275774c2"} Jun 05 21:31:23.625724 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.625688 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" event={"ID":"bab694ca-2dc0-4552-8389-88b5ce6bfdb5","Type":"ContainerStarted","Data":"1b46288d16d8f8cff9254baeaec0a47fcf76faa20e04434cd8c3eb54f2a78418"} Jun 05 21:31:23.627699 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.627672 2567 generic.go:356] "Generic (PLEG): container finished" podID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerID="9331ebb8ed02040c3ff6ab070d989207a31a5ad9fe3627c947d76608e1c9ff3e" exitCode=0 Jun 05 21:31:23.627857 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.627752 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" event={"ID":"c86db0eb-ab79-403d-baf4-a37ebb4db888","Type":"ContainerDied","Data":"9331ebb8ed02040c3ff6ab070d989207a31a5ad9fe3627c947d76608e1c9ff3e"} Jun 05 21:31:23.629531 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.629507 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" event={"ID":"07bdc101-34f9-43b0-824a-7d5a5e883550","Type":"ContainerStarted","Data":"89ab99824f69193c46181518e9e7c1fa0a7253b7e87a24fecef9a02038ada098"} Jun 05 21:31:23.629637 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.629616 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:23.631196 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.631162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" event={"ID":"6bc3e292-68a6-4178-a98f-1d27915b2251","Type":"ContainerStarted","Data":"0507a91b7671ac92c88f68188e2b106a3e359c305d497581ad0698a37a0859a0"} Jun 05 21:31:23.634351 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.634300 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:23.649455 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.649412 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bd79689b-q7tmc" podStartSLOduration=1.9422128170000001 podStartE2EDuration="6.649396817s" totalImagesPullingTime="4.707184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:23.646818109 +0000 UTC m=+768.715228008" watchObservedRunningTime="2026-06-05 21:31:23.649396817 +0000 UTC m=+768.717806715" Jun 05 21:31:23.687139 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.687086 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" podStartSLOduration=2.368783196 podStartE2EDuration="6.687069267s" totalImagesPullingTime="4.318286071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:23.665687939 +0000 UTC m=+768.734097840" watchObservedRunningTime="2026-06-05 21:31:23.687069267 +0000 UTC m=+768.755479185" Jun 05 21:31:23.704056 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:23.704010 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" podStartSLOduration=1.548005362 podStartE2EDuration="5.703994697s" totalImagesPullingTime="4.155989335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:23.701545092 +0000 UTC m=+768.769954991" watchObservedRunningTime="2026-06-05 21:31:23.703994697 +0000 UTC m=+768.772404596" Jun 05 21:31:24.638506 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:24.638472 2567 generic.go:356] "Generic (PLEG): container finished" podID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerID="96cc4b80bb851b4c8801c1fb573dfaed94717ef9833ecbb4e7e4009920e01cba" exitCode=0 Jun 05 21:31:24.638910 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:24.638557 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" event={"ID":"c86db0eb-ab79-403d-baf4-a37ebb4db888","Type":"ContainerDied","Data":"96cc4b80bb851b4c8801c1fb573dfaed94717ef9833ecbb4e7e4009920e01cba"} Jun 05 21:31:25.781730 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.781701 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:25.893225 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.893166 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc7ql\" (UniqueName: \"kubernetes.io/projected/c86db0eb-ab79-403d-baf4-a37ebb4db888-kube-api-access-tc7ql\") pod \"c86db0eb-ab79-403d-baf4-a37ebb4db888\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " Jun 05 21:31:25.893431 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.893236 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-util\") pod \"c86db0eb-ab79-403d-baf4-a37ebb4db888\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " Jun 05 21:31:25.893431 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.893304 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-bundle\") pod \"c86db0eb-ab79-403d-baf4-a37ebb4db888\" (UID: \"c86db0eb-ab79-403d-baf4-a37ebb4db888\") " Jun 05 21:31:25.894914 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.894825 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-bundle" (OuterVolumeSpecName: "bundle") pod "c86db0eb-ab79-403d-baf4-a37ebb4db888" (UID: "c86db0eb-ab79-403d-baf4-a37ebb4db888"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:31:25.895753 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.895723 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86db0eb-ab79-403d-baf4-a37ebb4db888-kube-api-access-tc7ql" (OuterVolumeSpecName: "kube-api-access-tc7ql") pod "c86db0eb-ab79-403d-baf4-a37ebb4db888" (UID: "c86db0eb-ab79-403d-baf4-a37ebb4db888"). InnerVolumeSpecName "kube-api-access-tc7ql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:31:25.898526 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.898496 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-util" (OuterVolumeSpecName: "util") pod "c86db0eb-ab79-403d-baf4-a37ebb4db888" (UID: "c86db0eb-ab79-403d-baf4-a37ebb4db888"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:31:25.994777 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.994744 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc7ql\" (UniqueName: \"kubernetes.io/projected/c86db0eb-ab79-403d-baf4-a37ebb4db888-kube-api-access-tc7ql\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:31:25.994777 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.994772 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:31:25.994777 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:25.994781 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c86db0eb-ab79-403d-baf4-a37ebb4db888-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:31:26.650892 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:26.650854 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" event={"ID":"c86db0eb-ab79-403d-baf4-a37ebb4db888","Type":"ContainerDied","Data":"9e51eb37ead0c3feeb197183ca5f566eec9c9ddd0af526c9686560465e1a794f"} Jun 05 21:31:26.651102 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:26.650895 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06sv8qh" Jun 05 21:31:26.651102 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:26.650909 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e51eb37ead0c3feeb197183ca5f566eec9c9ddd0af526c9686560465e1a794f" Jun 05 21:31:27.461428 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.461394 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:27.526518 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.526482 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mwrbj"] Jun 05 21:31:27.526950 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.526933 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerName="util" Jun 05 21:31:27.527036 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.526953 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerName="util" Jun 05 21:31:27.527036 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.526987 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerName="pull" Jun 05 21:31:27.527036 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.526996 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerName="pull" Jun 05 21:31:27.527036 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.527015 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerName="extract" Jun 05 21:31:27.527036 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.527023 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerName="extract" Jun 05 21:31:27.527280 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.527111 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c86db0eb-ab79-403d-baf4-a37ebb4db888" containerName="extract" Jun 05 21:31:27.529801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.529778 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:31:27.533283 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.533262 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 05 21:31:27.533283 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.533278 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-d8nch\"" Jun 05 21:31:27.538482 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.538461 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd"] Jun 05 21:31:27.541892 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.541869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:27.544500 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.544482 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 21:31:27.544681 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.544664 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mwrbj"] Jun 05 21:31:27.545183 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.545167 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xh7hv\"" Jun 05 21:31:27.561502 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.561461 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:27.561867 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.561848 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd"] Jun 05 21:31:27.711248 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.711217 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/056ddee3-3a33-44b6-b168-07a31437cbe1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7vlpd\" (UID: \"056ddee3-3a33-44b6-b168-07a31437cbe1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:27.711500 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.711282 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6gdb\" (UniqueName: \"kubernetes.io/projected/056ddee3-3a33-44b6-b168-07a31437cbe1-kube-api-access-t6gdb\") pod \"llmisvc-controller-manager-864bfd7bc9-7vlpd\" (UID: \"056ddee3-3a33-44b6-b168-07a31437cbe1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:27.711500 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.711392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwb6s\" (UniqueName: \"kubernetes.io/projected/4d866d55-b901-4f85-b320-5e073b8b65d2-kube-api-access-qwb6s\") pod \"kserve-controller-manager-69fc866d76-mwrbj\" (UID: \"4d866d55-b901-4f85-b320-5e073b8b65d2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:31:27.711500 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.711429 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d866d55-b901-4f85-b320-5e073b8b65d2-cert\") pod \"kserve-controller-manager-69fc866d76-mwrbj\" (UID: \"4d866d55-b901-4f85-b320-5e073b8b65d2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:31:27.812114 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.812076 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwb6s\" (UniqueName: \"kubernetes.io/projected/4d866d55-b901-4f85-b320-5e073b8b65d2-kube-api-access-qwb6s\") pod \"kserve-controller-manager-69fc866d76-mwrbj\" (UID: \"4d866d55-b901-4f85-b320-5e073b8b65d2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:31:27.812314 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.812122 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d866d55-b901-4f85-b320-5e073b8b65d2-cert\") pod \"kserve-controller-manager-69fc866d76-mwrbj\" (UID: \"4d866d55-b901-4f85-b320-5e073b8b65d2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:31:27.812314 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.812168 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/056ddee3-3a33-44b6-b168-07a31437cbe1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7vlpd\" (UID: \"056ddee3-3a33-44b6-b168-07a31437cbe1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:27.812314 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.812215 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6gdb\" (UniqueName: \"kubernetes.io/projected/056ddee3-3a33-44b6-b168-07a31437cbe1-kube-api-access-t6gdb\") pod \"llmisvc-controller-manager-864bfd7bc9-7vlpd\" (UID: \"056ddee3-3a33-44b6-b168-07a31437cbe1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:27.812314 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:31:27.812293 2567 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 05 21:31:27.812565 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:31:27.812379 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/056ddee3-3a33-44b6-b168-07a31437cbe1-cert podName:056ddee3-3a33-44b6-b168-07a31437cbe1 nodeName:}" failed. No retries permitted until 2026-06-05 21:31:28.312359522 +0000 UTC m=+773.380769403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/056ddee3-3a33-44b6-b168-07a31437cbe1-cert") pod "llmisvc-controller-manager-864bfd7bc9-7vlpd" (UID: "056ddee3-3a33-44b6-b168-07a31437cbe1") : secret "llmisvc-webhook-server-cert" not found Jun 05 21:31:27.814861 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.814836 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d866d55-b901-4f85-b320-5e073b8b65d2-cert\") pod \"kserve-controller-manager-69fc866d76-mwrbj\" (UID: \"4d866d55-b901-4f85-b320-5e073b8b65d2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:31:27.833790 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.833759 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:27.835898 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.835876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwb6s\" (UniqueName: \"kubernetes.io/projected/4d866d55-b901-4f85-b320-5e073b8b65d2-kube-api-access-qwb6s\") pod \"kserve-controller-manager-69fc866d76-mwrbj\" (UID: \"4d866d55-b901-4f85-b320-5e073b8b65d2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:31:27.836116 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.836096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6gdb\" (UniqueName: \"kubernetes.io/projected/056ddee3-3a33-44b6-b168-07a31437cbe1-kube-api-access-t6gdb\") pod \"llmisvc-controller-manager-864bfd7bc9-7vlpd\" (UID: \"056ddee3-3a33-44b6-b168-07a31437cbe1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:27.839841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.839814 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:31:27.985603 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:27.985575 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-mwrbj"] Jun 05 21:31:27.986856 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:27.986830 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d866d55_b901_4f85_b320_5e073b8b65d2.slice/crio-ca96f28f04fab4a260764d7b4469312717645ef8e690cbbe45dd4852daf589e3 WatchSource:0}: Error finding container ca96f28f04fab4a260764d7b4469312717645ef8e690cbbe45dd4852daf589e3: Status 404 returned error can't find the container with id ca96f28f04fab4a260764d7b4469312717645ef8e690cbbe45dd4852daf589e3 Jun 05 21:31:28.001010 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:28.000989 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:28.316627 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:28.316578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/056ddee3-3a33-44b6-b168-07a31437cbe1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7vlpd\" (UID: \"056ddee3-3a33-44b6-b168-07a31437cbe1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:28.318993 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:28.318970 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/056ddee3-3a33-44b6-b168-07a31437cbe1-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-7vlpd\" (UID: \"056ddee3-3a33-44b6-b168-07a31437cbe1\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:28.452105 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:28.452069 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:28.597766 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:28.597739 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd"] Jun 05 21:31:28.598637 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:28.598614 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod056ddee3_3a33_44b6_b168_07a31437cbe1.slice/crio-3668121ab6e60915dd0e5c9db3f0cbe0de67e2dc268bcbbc738b375c3500a513 WatchSource:0}: Error finding container 3668121ab6e60915dd0e5c9db3f0cbe0de67e2dc268bcbbc738b375c3500a513: Status 404 returned error can't find the container with id 3668121ab6e60915dd0e5c9db3f0cbe0de67e2dc268bcbbc738b375c3500a513 Jun 05 21:31:28.662177 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:28.662132 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" event={"ID":"056ddee3-3a33-44b6-b168-07a31437cbe1","Type":"ContainerStarted","Data":"3668121ab6e60915dd0e5c9db3f0cbe0de67e2dc268bcbbc738b375c3500a513"} Jun 05 21:31:28.663351 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:28.663305 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" event={"ID":"4d866d55-b901-4f85-b320-5e073b8b65d2","Type":"ContainerStarted","Data":"ca96f28f04fab4a260764d7b4469312717645ef8e690cbbe45dd4852daf589e3"} Jun 05 21:31:28.783076 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:28.783007 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:29.010010 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:29.009972 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:30.277644 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:30.277611 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:30.397709 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:30.397669 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:31.467277 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.467238 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df"] Jun 05 21:31:31.471537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.471505 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.474317 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.474294 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 21:31:31.474679 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.474616 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qx4hd\"" Jun 05 21:31:31.480859 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.480467 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 21:31:31.487033 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.487003 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df"] Jun 05 21:31:31.546697 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.546652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dx5v\" (UniqueName: \"kubernetes.io/projected/381bab6f-f4f5-4528-a0b4-8941ed96e83b-kube-api-access-7dx5v\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.546884 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.546747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.546937 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.546884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.647917 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.647873 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.648106 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.647944 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dx5v\" (UniqueName: \"kubernetes.io/projected/381bab6f-f4f5-4528-a0b4-8941ed96e83b-kube-api-access-7dx5v\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.648106 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.648019 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.648342 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.648297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.648446 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.648421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.666874 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.666840 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dx5v\" (UniqueName: \"kubernetes.io/projected/381bab6f-f4f5-4528-a0b4-8941ed96e83b-kube-api-access-7dx5v\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.734166 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.734082 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:31.783537 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.783504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:31.867807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.867769 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:31.987360 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:31.987270 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:32.184641 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.184611 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df"] Jun 05 21:31:32.186388 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:32.186360 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381bab6f_f4f5_4528_a0b4_8941ed96e83b.slice/crio-e1a85a96add6782fd13a92a8c69a9521c27248ae101206a06f94cbf5b9d28d84 WatchSource:0}: Error finding container e1a85a96add6782fd13a92a8c69a9521c27248ae101206a06f94cbf5b9d28d84: Status 404 returned error can't find the container with id e1a85a96add6782fd13a92a8c69a9521c27248ae101206a06f94cbf5b9d28d84 Jun 05 21:31:32.215802 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.215775 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:32.653063 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.652971 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:32.695121 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.695082 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" event={"ID":"056ddee3-3a33-44b6-b168-07a31437cbe1","Type":"ContainerStarted","Data":"5fe7b3291a61f189bc1a5e8aebb430290911059e0081f334cbe97032c06ec40b"} Jun 05 21:31:32.695361 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.695230 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:31:32.696854 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.696829 2567 generic.go:356] "Generic (PLEG): container finished" podID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerID="411a73b9a3ae04934c4ae022986183cde01d70f5ea03f979eb495a754c5555aa" exitCode=0 Jun 05 21:31:32.696995 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.696915 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" event={"ID":"381bab6f-f4f5-4528-a0b4-8941ed96e83b","Type":"ContainerDied","Data":"411a73b9a3ae04934c4ae022986183cde01d70f5ea03f979eb495a754c5555aa"} Jun 05 21:31:32.696995 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.696963 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" event={"ID":"381bab6f-f4f5-4528-a0b4-8941ed96e83b","Type":"ContainerStarted","Data":"e1a85a96add6782fd13a92a8c69a9521c27248ae101206a06f94cbf5b9d28d84"} Jun 05 21:31:32.698832 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.698793 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" event={"ID":"4d866d55-b901-4f85-b320-5e073b8b65d2","Type":"ContainerStarted","Data":"5e47ccf38038073d3fe48a5c730b755e6ed1b63f94798bb320de40ddcf727429"} Jun 05 21:31:32.698901 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.698858 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:31:32.716017 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.715964 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" podStartSLOduration=2.292417056 podStartE2EDuration="5.71594786s" totalImagesPullingTime="3.423530804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:32.714421533 +0000 UTC m=+777.782831432" watchObservedRunningTime="2026-06-05 21:31:32.71594786 +0000 UTC m=+777.784357801" Jun 05 21:31:32.776849 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:32.776799 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" podStartSLOduration=1.746427505 podStartE2EDuration="5.776786055s" totalImagesPullingTime="4.03035855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:32.776450741 +0000 UTC m=+777.844860641" watchObservedRunningTime="2026-06-05 21:31:32.776786055 +0000 UTC m=+777.845195953" Jun 05 21:31:33.270320 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.270284 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-cbttx"] Jun 05 21:31:33.273890 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.273867 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:33.277348 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.277310 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-bpnxx\"" Jun 05 21:31:33.277883 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.277866 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 21:31:33.277956 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.277933 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 21:31:33.289115 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.289088 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-cbttx"] Jun 05 21:31:33.364247 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.364188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9xkt\" (UniqueName: \"kubernetes.io/projected/b8e13098-0626-4a41-ad73-3c26559d300a-kube-api-access-k9xkt\") pod \"servicemesh-operator3-57f65f65fb-cbttx\" (UID: \"b8e13098-0626-4a41-ad73-3c26559d300a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:33.364454 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.364318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b8e13098-0626-4a41-ad73-3c26559d300a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-cbttx\" (UID: \"b8e13098-0626-4a41-ad73-3c26559d300a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:33.465131 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.465099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9xkt\" (UniqueName: \"kubernetes.io/projected/b8e13098-0626-4a41-ad73-3c26559d300a-kube-api-access-k9xkt\") pod \"servicemesh-operator3-57f65f65fb-cbttx\" (UID: \"b8e13098-0626-4a41-ad73-3c26559d300a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:33.465320 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.465244 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b8e13098-0626-4a41-ad73-3c26559d300a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-cbttx\" (UID: \"b8e13098-0626-4a41-ad73-3c26559d300a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:33.467807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.467787 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b8e13098-0626-4a41-ad73-3c26559d300a-operator-config\") pod \"servicemesh-operator3-57f65f65fb-cbttx\" (UID: \"b8e13098-0626-4a41-ad73-3c26559d300a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:33.477416 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.477392 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9xkt\" (UniqueName: \"kubernetes.io/projected/b8e13098-0626-4a41-ad73-3c26559d300a-kube-api-access-k9xkt\") pod \"servicemesh-operator3-57f65f65fb-cbttx\" (UID: \"b8e13098-0626-4a41-ad73-3c26559d300a\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:33.583681 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.583598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:33.598531 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.598500 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-f857d6fdf-mlrf7"] Jun 05 21:31:33.603005 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.602978 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" Jun 05 21:31:33.606240 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.606178 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7dhnm\"" Jun 05 21:31:33.606718 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.606697 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 21:31:33.621192 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.621151 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f857d6fdf-mlrf7"] Jun 05 21:31:33.659412 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.659383 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:33.667065 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.666936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3f31ee75-d56a-4c0e-a46a-bee5574d0c70-redirect-config\") pod \"dashboard-redirect-f857d6fdf-mlrf7\" (UID: \"3f31ee75-d56a-4c0e-a46a-bee5574d0c70\") " pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" Jun 05 21:31:33.667065 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.666994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb22t\" (UniqueName: \"kubernetes.io/projected/3f31ee75-d56a-4c0e-a46a-bee5574d0c70-kube-api-access-hb22t\") pod \"dashboard-redirect-f857d6fdf-mlrf7\" (UID: \"3f31ee75-d56a-4c0e-a46a-bee5574d0c70\") " pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" Jun 05 21:31:33.757294 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.757260 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-cbttx"] Jun 05 21:31:33.758158 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:33.758134 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e13098_0626_4a41_ad73_3c26559d300a.slice/crio-4d886ccfacb96a34d357b576ec04cb54feafebf677a6399bb6033514918bec6a WatchSource:0}: Error finding container 4d886ccfacb96a34d357b576ec04cb54feafebf677a6399bb6033514918bec6a: Status 404 returned error can't find the container with id 4d886ccfacb96a34d357b576ec04cb54feafebf677a6399bb6033514918bec6a Jun 05 21:31:33.768495 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.768465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3f31ee75-d56a-4c0e-a46a-bee5574d0c70-redirect-config\") pod \"dashboard-redirect-f857d6fdf-mlrf7\" (UID: \"3f31ee75-d56a-4c0e-a46a-bee5574d0c70\") " pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" Jun 05 21:31:33.768610 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.768592 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb22t\" (UniqueName: \"kubernetes.io/projected/3f31ee75-d56a-4c0e-a46a-bee5574d0c70-kube-api-access-hb22t\") pod \"dashboard-redirect-f857d6fdf-mlrf7\" (UID: \"3f31ee75-d56a-4c0e-a46a-bee5574d0c70\") " pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" Jun 05 21:31:33.769168 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.769147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3f31ee75-d56a-4c0e-a46a-bee5574d0c70-redirect-config\") pod \"dashboard-redirect-f857d6fdf-mlrf7\" (UID: \"3f31ee75-d56a-4c0e-a46a-bee5574d0c70\") " pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" Jun 05 21:31:33.781687 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.781657 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb22t\" (UniqueName: \"kubernetes.io/projected/3f31ee75-d56a-4c0e-a46a-bee5574d0c70-kube-api-access-hb22t\") pod \"dashboard-redirect-f857d6fdf-mlrf7\" (UID: \"3f31ee75-d56a-4c0e-a46a-bee5574d0c70\") " pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" Jun 05 21:31:33.932376 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:33.932246 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" Jun 05 21:31:34.091194 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:34.091168 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f857d6fdf-mlrf7"] Jun 05 21:31:34.093833 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:34.093801 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f31ee75_d56a_4c0e_a46a_bee5574d0c70.slice/crio-364eb68c340dee594198d89ad06c3bf753769836f04ea3e108c4c4fbc92ec480 WatchSource:0}: Error finding container 364eb68c340dee594198d89ad06c3bf753769836f04ea3e108c4c4fbc92ec480: Status 404 returned error can't find the container with id 364eb68c340dee594198d89ad06c3bf753769836f04ea3e108c4c4fbc92ec480 Jun 05 21:31:34.642087 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:34.642056 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-p4whr" Jun 05 21:31:34.645186 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:34.645161 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-h5v5r" Jun 05 21:31:34.716298 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:34.716194 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" event={"ID":"b8e13098-0626-4a41-ad73-3c26559d300a","Type":"ContainerStarted","Data":"4d886ccfacb96a34d357b576ec04cb54feafebf677a6399bb6033514918bec6a"} Jun 05 21:31:34.719532 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:34.719465 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" event={"ID":"3f31ee75-d56a-4c0e-a46a-bee5574d0c70","Type":"ContainerStarted","Data":"364eb68c340dee594198d89ad06c3bf753769836f04ea3e108c4c4fbc92ec480"} Jun 05 21:31:34.725649 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:34.725617 2567 generic.go:356] "Generic (PLEG): container finished" podID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerID="59c14ea8910b71cd14db2be0363aa76963bcd817c25d2c0449dc9f6012686425" exitCode=0 Jun 05 21:31:34.725820 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:34.725686 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" event={"ID":"381bab6f-f4f5-4528-a0b4-8941ed96e83b","Type":"ContainerDied","Data":"59c14ea8910b71cd14db2be0363aa76963bcd817c25d2c0449dc9f6012686425"} Jun 05 21:31:35.734881 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:35.734846 2567 generic.go:356] "Generic (PLEG): container finished" podID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerID="f1a8c6e8641cb65ee58f64ad12a4d904ef6b74cd223fa66a2ef46829e9bd6048" exitCode=0 Jun 05 21:31:35.735362 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:35.734913 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" event={"ID":"381bab6f-f4f5-4528-a0b4-8941ed96e83b","Type":"ContainerDied","Data":"f1a8c6e8641cb65ee58f64ad12a4d904ef6b74cd223fa66a2ef46829e9bd6048"} Jun 05 21:31:36.745392 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:36.744882 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" event={"ID":"b8e13098-0626-4a41-ad73-3c26559d300a","Type":"ContainerStarted","Data":"227153c12ec97917260aab205af98f5ebf59b0e1ae0b995307999edb58a7917d"} Jun 05 21:31:36.745392 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:36.745185 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:36.787769 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:36.786438 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" podStartSLOduration=1.245205863 podStartE2EDuration="3.786415192s" totalImagesPullingTime="2.541209329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:36.783550273 +0000 UTC m=+781.851960173" watchObservedRunningTime="2026-06-05 21:31:36.786415192 +0000 UTC m=+781.854825092" Jun 05 21:31:37.280087 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.280057 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:37.307559 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.307523 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-util\") pod \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " Jun 05 21:31:37.307772 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.307594 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dx5v\" (UniqueName: \"kubernetes.io/projected/381bab6f-f4f5-4528-a0b4-8941ed96e83b-kube-api-access-7dx5v\") pod \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " Jun 05 21:31:37.307772 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.307619 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-bundle\") pod \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\" (UID: \"381bab6f-f4f5-4528-a0b4-8941ed96e83b\") " Jun 05 21:31:37.308917 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.308870 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-bundle" (OuterVolumeSpecName: "bundle") pod "381bab6f-f4f5-4528-a0b4-8941ed96e83b" (UID: "381bab6f-f4f5-4528-a0b4-8941ed96e83b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:31:37.310912 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.310870 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/381bab6f-f4f5-4528-a0b4-8941ed96e83b-kube-api-access-7dx5v" (OuterVolumeSpecName: "kube-api-access-7dx5v") pod "381bab6f-f4f5-4528-a0b4-8941ed96e83b" (UID: "381bab6f-f4f5-4528-a0b4-8941ed96e83b"). InnerVolumeSpecName "kube-api-access-7dx5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:31:37.314233 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.314208 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-util" (OuterVolumeSpecName: "util") pod "381bab6f-f4f5-4528-a0b4-8941ed96e83b" (UID: "381bab6f-f4f5-4528-a0b4-8941ed96e83b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:31:37.409409 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.409371 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:31:37.409409 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.409408 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dx5v\" (UniqueName: \"kubernetes.io/projected/381bab6f-f4f5-4528-a0b4-8941ed96e83b-kube-api-access-7dx5v\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:31:37.409649 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.409423 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/381bab6f-f4f5-4528-a0b4-8941ed96e83b-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:31:37.752998 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.752975 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" Jun 05 21:31:37.753313 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.752994 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ac29df" event={"ID":"381bab6f-f4f5-4528-a0b4-8941ed96e83b","Type":"ContainerDied","Data":"e1a85a96add6782fd13a92a8c69a9521c27248ae101206a06f94cbf5b9d28d84"} Jun 05 21:31:37.753313 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:37.753046 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1a85a96add6782fd13a92a8c69a9521c27248ae101206a06f94cbf5b9d28d84" Jun 05 21:31:38.760044 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:38.760004 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" event={"ID":"3f31ee75-d56a-4c0e-a46a-bee5574d0c70","Type":"ContainerStarted","Data":"5ba133c0586f7599c6e5d8f3daa1e342c260c2ab5a7ed00df58a9e51937273cb"} Jun 05 21:31:38.778552 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:38.778500 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-f857d6fdf-mlrf7" podStartSLOduration=2.139375331 podStartE2EDuration="5.778482794s" totalImagesPullingTime="3.639107463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:38.776148201 +0000 UTC m=+783.844558117" watchObservedRunningTime="2026-06-05 21:31:38.778482794 +0000 UTC m=+783.846892694" Jun 05 21:31:43.023896 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.023795 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:43.075447 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.075411 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r"] Jun 05 21:31:43.075870 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.075853 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerName="util" Jun 05 21:31:43.075918 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.075875 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerName="util" Jun 05 21:31:43.075918 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.075903 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerName="extract" Jun 05 21:31:43.075918 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.075913 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerName="extract" Jun 05 21:31:43.076020 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.075940 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerName="pull" Jun 05 21:31:43.076020 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.075949 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerName="pull" Jun 05 21:31:43.076091 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.076065 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="381bab6f-f4f5-4528-a0b4-8941ed96e83b" containerName="extract" Jun 05 21:31:43.080291 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.080264 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.082903 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.082883 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 05 21:31:43.083170 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.083151 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 05 21:31:43.083275 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.083259 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-l8vwl\"" Jun 05 21:31:43.083499 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.083481 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 21:31:43.083499 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.083490 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 05 21:31:43.093131 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.093101 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r"] Jun 05 21:31:43.094871 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.094819 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:43.150880 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.150819 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:43.162803 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.162771 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lwks\" (UniqueName: \"kubernetes.io/projected/d3078487-f485-4c49-bfe0-1b2915c4445d-kube-api-access-6lwks\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.162982 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.162819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.162982 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.162891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3078487-f485-4c49-bfe0-1b2915c4445d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.162982 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.162935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d3078487-f485-4c49-bfe0-1b2915c4445d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.162982 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.162957 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.162982 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.162977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.163192 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.163087 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.264573 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.264533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.264765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.264590 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3078487-f485-4c49-bfe0-1b2915c4445d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.264765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.264609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d3078487-f485-4c49-bfe0-1b2915c4445d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.264765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.264624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.264765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.264640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.264765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.264672 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.264765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.264729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lwks\" (UniqueName: \"kubernetes.io/projected/d3078487-f485-4c49-bfe0-1b2915c4445d-kube-api-access-6lwks\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.265224 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.265199 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.267232 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.267201 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d3078487-f485-4c49-bfe0-1b2915c4445d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.267416 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.267289 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.267488 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.267423 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3078487-f485-4c49-bfe0-1b2915c4445d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.267488 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.267478 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.272754 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.272730 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3078487-f485-4c49-bfe0-1b2915c4445d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.273072 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.273051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lwks\" (UniqueName: \"kubernetes.io/projected/d3078487-f485-4c49-bfe0-1b2915c4445d-kube-api-access-6lwks\") pod \"istiod-openshift-gateway-75c67f8887-52b5r\" (UID: \"d3078487-f485-4c49-bfe0-1b2915c4445d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.393170 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.393074 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:43.541419 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.541388 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r"] Jun 05 21:31:43.543826 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:31:43.543797 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3078487_f485_4c49_bfe0_1b2915c4445d.slice/crio-3f8654dfb4ed5a4ae21e90463795221f193dbc8fc9194c9741b76b70965ffa81 WatchSource:0}: Error finding container 3f8654dfb4ed5a4ae21e90463795221f193dbc8fc9194c9741b76b70965ffa81: Status 404 returned error can't find the container with id 3f8654dfb4ed5a4ae21e90463795221f193dbc8fc9194c9741b76b70965ffa81 Jun 05 21:31:43.673085 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.672978 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:43.794373 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:43.794320 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" event={"ID":"d3078487-f485-4c49-bfe0-1b2915c4445d","Type":"ContainerStarted","Data":"3f8654dfb4ed5a4ae21e90463795221f193dbc8fc9194c9741b76b70965ffa81"} Jun 05 21:31:46.224521 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:46.224468 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:31:46.224803 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:46.224560 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 05 21:31:46.814506 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:46.814466 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" event={"ID":"d3078487-f485-4c49-bfe0-1b2915c4445d","Type":"ContainerStarted","Data":"6053b3f7543dd028d9ea9056d385357e3ec7f33ec1d1e85abea7663912b47a32"} Jun 05 21:31:46.814730 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:46.814525 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:46.835253 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:46.835201 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" podStartSLOduration=1.157611162 podStartE2EDuration="3.835186565s" totalImagesPullingTime="2.677575403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:31:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:31:46.833378808 +0000 UTC m=+791.901788708" watchObservedRunningTime="2026-06-05 21:31:46.835186565 +0000 UTC m=+791.903596463" Jun 05 21:31:47.366380 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:47.366338 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:47.478015 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:47.477982 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:47.727770 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:47.727683 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:47.754864 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:47.754836 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-cbttx" Jun 05 21:31:47.823290 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:47.823248 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-52b5r" Jun 05 21:31:47.827666 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:47.827623 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:47.947713 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:47.947683 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:31:48.101060 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:31:48.101017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:03.707798 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:03.707766 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-7vlpd" Jun 05 21:32:03.710538 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:03.710518 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-mwrbj" Jun 05 21:32:18.031490 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:18.031455 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:18.134921 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:18.134883 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:18.202632 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:18.202590 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:18.950149 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:18.950062 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:19.151899 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:19.151866 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:33.367624 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.367588 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2"] Jun 05 21:32:33.377104 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.377068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.379700 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.379672 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2"] Jun 05 21:32:33.380019 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.379998 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 21:32:33.381038 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.381016 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lfm28\"" Jun 05 21:32:33.381140 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.381089 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 21:32:33.418448 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.418400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6kcw\" (UniqueName: \"kubernetes.io/projected/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-kube-api-access-z6kcw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.418448 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.418452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.418681 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.418624 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.519956 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.519917 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.519956 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.519958 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6kcw\" (UniqueName: \"kubernetes.io/projected/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-kube-api-access-z6kcw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.520239 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.519976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.520429 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.520408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.520429 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.520419 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.528804 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.528779 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6kcw\" (UniqueName: \"kubernetes.io/projected/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-kube-api-access-z6kcw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.689078 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.688993 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:33.763554 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.763522 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5"] Jun 05 21:32:33.768129 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.768107 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:33.775658 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.775628 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5"] Jun 05 21:32:33.822599 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.822559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dv55\" (UniqueName: \"kubernetes.io/projected/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-kube-api-access-5dv55\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:33.822776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.822670 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:33.822846 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.822826 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:33.836081 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.836057 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2"] Jun 05 21:32:33.837502 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:32:33.837471 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e78d5a6_35af_4674_9ee5_3ab40d051a4b.slice/crio-c3ec6b6bebfc771e594ff1a8bafcad36fedd39e97a4e9137fadd6269ce392863 WatchSource:0}: Error finding container c3ec6b6bebfc771e594ff1a8bafcad36fedd39e97a4e9137fadd6269ce392863: Status 404 returned error can't find the container with id c3ec6b6bebfc771e594ff1a8bafcad36fedd39e97a4e9137fadd6269ce392863 Jun 05 21:32:33.923439 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.923404 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dv55\" (UniqueName: \"kubernetes.io/projected/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-kube-api-access-5dv55\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:33.923620 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.923461 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:33.923620 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.923546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:33.923883 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.923864 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:33.923927 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.923899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:33.932871 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:33.932835 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dv55\" (UniqueName: \"kubernetes.io/projected/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-kube-api-access-5dv55\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:34.079524 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.079492 2567 generic.go:356] "Generic (PLEG): container finished" podID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerID="3c9e3f3e946535a3c2c6eb434a7c2ec9170482fab6bbf48105f21177ee61317b" exitCode=0 Jun 05 21:32:34.079711 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.079586 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" event={"ID":"8e78d5a6-35af-4674-9ee5-3ab40d051a4b","Type":"ContainerDied","Data":"3c9e3f3e946535a3c2c6eb434a7c2ec9170482fab6bbf48105f21177ee61317b"} Jun 05 21:32:34.079711 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.079643 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" event={"ID":"8e78d5a6-35af-4674-9ee5-3ab40d051a4b","Type":"ContainerStarted","Data":"c3ec6b6bebfc771e594ff1a8bafcad36fedd39e97a4e9137fadd6269ce392863"} Jun 05 21:32:34.081507 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.081487 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:34.221675 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.221648 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5"] Jun 05 21:32:34.222601 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:32:34.222571 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd837b1dc_c2ad_4780_ab2d_ba00c9a3bf7b.slice/crio-bd77249805737d12876d51bc489b001e9b45252a02e61fecc4368d70dae244d2 WatchSource:0}: Error finding container bd77249805737d12876d51bc489b001e9b45252a02e61fecc4368d70dae244d2: Status 404 returned error can't find the container with id bd77249805737d12876d51bc489b001e9b45252a02e61fecc4368d70dae244d2 Jun 05 21:32:34.363760 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.363729 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l"] Jun 05 21:32:34.367528 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.367511 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.374991 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.374962 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l"] Jun 05 21:32:34.429059 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.429023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnvkp\" (UniqueName: \"kubernetes.io/projected/661b9e7b-3d5f-4576-81e7-02bdfe23045e-kube-api-access-vnvkp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.429229 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.429068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.429229 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.429139 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.530475 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.530428 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnvkp\" (UniqueName: \"kubernetes.io/projected/661b9e7b-3d5f-4576-81e7-02bdfe23045e-kube-api-access-vnvkp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.530679 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.530503 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.530679 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.530544 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.530994 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.530976 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.531045 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.531021 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.539699 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.539676 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnvkp\" (UniqueName: \"kubernetes.io/projected/661b9e7b-3d5f-4576-81e7-02bdfe23045e-kube-api-access-vnvkp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.706113 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.706078 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:34.849474 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.849451 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l"] Jun 05 21:32:34.850670 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:32:34.850646 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod661b9e7b_3d5f_4576_81e7_02bdfe23045e.slice/crio-1d341164958fcdc492f8a457d5fd9a071ffbab53eb9451132d330e82e38ff5c2 WatchSource:0}: Error finding container 1d341164958fcdc492f8a457d5fd9a071ffbab53eb9451132d330e82e38ff5c2: Status 404 returned error can't find the container with id 1d341164958fcdc492f8a457d5fd9a071ffbab53eb9451132d330e82e38ff5c2 Jun 05 21:32:34.961851 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.961816 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll"] Jun 05 21:32:34.973049 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.973020 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:34.973196 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:34.973169 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll"] Jun 05 21:32:35.034434 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.034400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.034590 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.034442 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.034590 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.034494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5bnr\" (UniqueName: \"kubernetes.io/projected/8c5d2690-f2b3-4905-bae7-03e412bd39a1-kube-api-access-s5bnr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.086923 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.086836 2567 generic.go:356] "Generic (PLEG): container finished" podID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerID="3b345f0cc33a4708d75e2429c255416a3c285a4405debd6e0ac4fd7ed12deef8" exitCode=0 Jun 05 21:32:35.087091 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.086925 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" event={"ID":"661b9e7b-3d5f-4576-81e7-02bdfe23045e","Type":"ContainerDied","Data":"3b345f0cc33a4708d75e2429c255416a3c285a4405debd6e0ac4fd7ed12deef8"} Jun 05 21:32:35.087091 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.086985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" event={"ID":"661b9e7b-3d5f-4576-81e7-02bdfe23045e","Type":"ContainerStarted","Data":"1d341164958fcdc492f8a457d5fd9a071ffbab53eb9451132d330e82e38ff5c2"} Jun 05 21:32:35.089079 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.089056 2567 generic.go:356] "Generic (PLEG): container finished" podID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerID="bd5dae19b58942b57aa1f7761e753eed8fbbb85bb67d72bd0b04b71341b7d18b" exitCode=0 Jun 05 21:32:35.089199 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.089139 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" event={"ID":"8e78d5a6-35af-4674-9ee5-3ab40d051a4b","Type":"ContainerDied","Data":"bd5dae19b58942b57aa1f7761e753eed8fbbb85bb67d72bd0b04b71341b7d18b"} Jun 05 21:32:35.090727 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.090707 2567 generic.go:356] "Generic (PLEG): container finished" podID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerID="14c23d469a98c92677ac49a8a926452c09f455490c43d59f96495fcc9f46ba99" exitCode=0 Jun 05 21:32:35.090833 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.090816 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" event={"ID":"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b","Type":"ContainerDied","Data":"14c23d469a98c92677ac49a8a926452c09f455490c43d59f96495fcc9f46ba99"} Jun 05 21:32:35.090910 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.090895 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" event={"ID":"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b","Type":"ContainerStarted","Data":"bd77249805737d12876d51bc489b001e9b45252a02e61fecc4368d70dae244d2"} Jun 05 21:32:35.135994 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.135966 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.136136 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.136005 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.136136 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.136041 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5bnr\" (UniqueName: \"kubernetes.io/projected/8c5d2690-f2b3-4905-bae7-03e412bd39a1-kube-api-access-s5bnr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.136366 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.136345 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.136416 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.136395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.148502 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.148475 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5bnr\" (UniqueName: \"kubernetes.io/projected/8c5d2690-f2b3-4905-bae7-03e412bd39a1-kube-api-access-s5bnr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.330287 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.330243 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:35.473587 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:35.473553 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll"] Jun 05 21:32:35.474700 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:32:35.474669 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5d2690_f2b3_4905_bae7_03e412bd39a1.slice/crio-a81b620087e4f3beb5f1c41c6e29ce3465aa5f69b0a151af89e1ecaaa23f512d WatchSource:0}: Error finding container a81b620087e4f3beb5f1c41c6e29ce3465aa5f69b0a151af89e1ecaaa23f512d: Status 404 returned error can't find the container with id a81b620087e4f3beb5f1c41c6e29ce3465aa5f69b0a151af89e1ecaaa23f512d Jun 05 21:32:36.100415 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:36.100372 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" event={"ID":"661b9e7b-3d5f-4576-81e7-02bdfe23045e","Type":"ContainerStarted","Data":"81945e5e4d17cfedfda00bdfbd26396f6e068fe27817042a75c59aed25ce4910"} Jun 05 21:32:36.103190 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:36.103164 2567 generic.go:356] "Generic (PLEG): container finished" podID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerID="5ba3cf2ee5e7cbdce08830fb7b01499779327783b400b6f9661e559896e0563a" exitCode=0 Jun 05 21:32:36.103357 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:36.103235 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" event={"ID":"8e78d5a6-35af-4674-9ee5-3ab40d051a4b","Type":"ContainerDied","Data":"5ba3cf2ee5e7cbdce08830fb7b01499779327783b400b6f9661e559896e0563a"} Jun 05 21:32:36.105394 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:36.105366 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" event={"ID":"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b","Type":"ContainerStarted","Data":"3f11d5bd4c96bbc5bff62a567f95f52d11e6225b0bee81da166cbbb4fa8a4428"} Jun 05 21:32:36.107147 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:36.107124 2567 generic.go:356] "Generic (PLEG): container finished" podID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerID="797cfda5ef21e6acbe5a06b2451346a0cf79370ce8b4c9d872895cc559fcad11" exitCode=0 Jun 05 21:32:36.107239 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:36.107169 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" event={"ID":"8c5d2690-f2b3-4905-bae7-03e412bd39a1","Type":"ContainerDied","Data":"797cfda5ef21e6acbe5a06b2451346a0cf79370ce8b4c9d872895cc559fcad11"} Jun 05 21:32:36.107239 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:36.107204 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" event={"ID":"8c5d2690-f2b3-4905-bae7-03e412bd39a1","Type":"ContainerStarted","Data":"a81b620087e4f3beb5f1c41c6e29ce3465aa5f69b0a151af89e1ecaaa23f512d"} Jun 05 21:32:37.115472 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.115381 2567 generic.go:356] "Generic (PLEG): container finished" podID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerID="3f11d5bd4c96bbc5bff62a567f95f52d11e6225b0bee81da166cbbb4fa8a4428" exitCode=0 Jun 05 21:32:37.115472 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.115407 2567 generic.go:356] "Generic (PLEG): container finished" podID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerID="94c54383ea0b86e7e07abe8d057cbd1de3625d12ecb7ca614efa81ae581fd707" exitCode=0 Jun 05 21:32:37.115911 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.115471 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" event={"ID":"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b","Type":"ContainerDied","Data":"3f11d5bd4c96bbc5bff62a567f95f52d11e6225b0bee81da166cbbb4fa8a4428"} Jun 05 21:32:37.115911 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.115550 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" event={"ID":"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b","Type":"ContainerDied","Data":"94c54383ea0b86e7e07abe8d057cbd1de3625d12ecb7ca614efa81ae581fd707"} Jun 05 21:32:37.117288 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.117269 2567 generic.go:356] "Generic (PLEG): container finished" podID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerID="f1c3a1031519ab2a606ed782fb1fd5c796f2cf3f4ddcea8150719589c0ed0b62" exitCode=0 Jun 05 21:32:37.117372 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.117351 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" event={"ID":"8c5d2690-f2b3-4905-bae7-03e412bd39a1","Type":"ContainerDied","Data":"f1c3a1031519ab2a606ed782fb1fd5c796f2cf3f4ddcea8150719589c0ed0b62"} Jun 05 21:32:37.119236 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.119215 2567 generic.go:356] "Generic (PLEG): container finished" podID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerID="81945e5e4d17cfedfda00bdfbd26396f6e068fe27817042a75c59aed25ce4910" exitCode=0 Jun 05 21:32:37.119358 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.119292 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" event={"ID":"661b9e7b-3d5f-4576-81e7-02bdfe23045e","Type":"ContainerDied","Data":"81945e5e4d17cfedfda00bdfbd26396f6e068fe27817042a75c59aed25ce4910"} Jun 05 21:32:37.256533 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.255910 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:37.357820 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.357775 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-bundle\") pod \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " Jun 05 21:32:37.357820 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.357832 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6kcw\" (UniqueName: \"kubernetes.io/projected/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-kube-api-access-z6kcw\") pod \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " Jun 05 21:32:37.358030 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.357911 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-util\") pod \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\" (UID: \"8e78d5a6-35af-4674-9ee5-3ab40d051a4b\") " Jun 05 21:32:37.358481 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.358449 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-bundle" (OuterVolumeSpecName: "bundle") pod "8e78d5a6-35af-4674-9ee5-3ab40d051a4b" (UID: "8e78d5a6-35af-4674-9ee5-3ab40d051a4b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:32:37.360145 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.360121 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-kube-api-access-z6kcw" (OuterVolumeSpecName: "kube-api-access-z6kcw") pod "8e78d5a6-35af-4674-9ee5-3ab40d051a4b" (UID: "8e78d5a6-35af-4674-9ee5-3ab40d051a4b"). InnerVolumeSpecName "kube-api-access-z6kcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:32:37.364219 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.364191 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-util" (OuterVolumeSpecName: "util") pod "8e78d5a6-35af-4674-9ee5-3ab40d051a4b" (UID: "8e78d5a6-35af-4674-9ee5-3ab40d051a4b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:32:37.459261 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.459235 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:37.459261 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.459260 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6kcw\" (UniqueName: \"kubernetes.io/projected/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-kube-api-access-z6kcw\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:37.459463 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:37.459269 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e78d5a6-35af-4674-9ee5-3ab40d051a4b-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:38.127778 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.127742 2567 generic.go:356] "Generic (PLEG): container finished" podID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerID="a65d069df4e7aa0c4d3c7d6a80a92813853f52b2a26795235c58cc9c746001c3" exitCode=0 Jun 05 21:32:38.128266 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.127812 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" event={"ID":"661b9e7b-3d5f-4576-81e7-02bdfe23045e","Type":"ContainerDied","Data":"a65d069df4e7aa0c4d3c7d6a80a92813853f52b2a26795235c58cc9c746001c3"} Jun 05 21:32:38.130089 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.130037 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" Jun 05 21:32:38.130089 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.130049 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2" event={"ID":"8e78d5a6-35af-4674-9ee5-3ab40d051a4b","Type":"ContainerDied","Data":"c3ec6b6bebfc771e594ff1a8bafcad36fedd39e97a4e9137fadd6269ce392863"} Jun 05 21:32:38.130089 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.130090 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3ec6b6bebfc771e594ff1a8bafcad36fedd39e97a4e9137fadd6269ce392863" Jun 05 21:32:38.132704 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.132679 2567 generic.go:356] "Generic (PLEG): container finished" podID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerID="3c562d94e0a0b9fb50d812a516d39702de855e4d286d9c077a59c296162c6574" exitCode=0 Jun 05 21:32:38.132818 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.132745 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" event={"ID":"8c5d2690-f2b3-4905-bae7-03e412bd39a1","Type":"ContainerDied","Data":"3c562d94e0a0b9fb50d812a516d39702de855e4d286d9c077a59c296162c6574"} Jun 05 21:32:38.276776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.276749 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:38.367605 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.367566 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dv55\" (UniqueName: \"kubernetes.io/projected/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-kube-api-access-5dv55\") pod \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " Jun 05 21:32:38.367820 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.367667 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-bundle\") pod \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " Jun 05 21:32:38.367820 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.367742 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-util\") pod \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\" (UID: \"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b\") " Jun 05 21:32:38.368169 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.368143 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-bundle" (OuterVolumeSpecName: "bundle") pod "d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" (UID: "d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:32:38.369823 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.369803 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-kube-api-access-5dv55" (OuterVolumeSpecName: "kube-api-access-5dv55") pod "d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" (UID: "d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b"). InnerVolumeSpecName "kube-api-access-5dv55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:32:38.372909 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.372888 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-util" (OuterVolumeSpecName: "util") pod "d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" (UID: "d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:32:38.468827 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.468732 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:38.468827 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.468765 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:38.468827 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:38.468774 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dv55\" (UniqueName: \"kubernetes.io/projected/d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b-kube-api-access-5dv55\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:39.146211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.146172 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" event={"ID":"d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b","Type":"ContainerDied","Data":"bd77249805737d12876d51bc489b001e9b45252a02e61fecc4368d70dae244d2"} Jun 05 21:32:39.146211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.146202 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5" Jun 05 21:32:39.146766 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.146264 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd77249805737d12876d51bc489b001e9b45252a02e61fecc4368d70dae244d2" Jun 05 21:32:39.286196 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.286164 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:39.323548 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.323521 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:39.378395 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.378322 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-util\") pod \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " Jun 05 21:32:39.378588 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.378450 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-bundle\") pod \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " Jun 05 21:32:39.378588 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.378492 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5bnr\" (UniqueName: \"kubernetes.io/projected/8c5d2690-f2b3-4905-bae7-03e412bd39a1-kube-api-access-s5bnr\") pod \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\" (UID: \"8c5d2690-f2b3-4905-bae7-03e412bd39a1\") " Jun 05 21:32:39.378958 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.378932 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-bundle" (OuterVolumeSpecName: "bundle") pod "8c5d2690-f2b3-4905-bae7-03e412bd39a1" (UID: "8c5d2690-f2b3-4905-bae7-03e412bd39a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:32:39.380640 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.380612 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c5d2690-f2b3-4905-bae7-03e412bd39a1-kube-api-access-s5bnr" (OuterVolumeSpecName: "kube-api-access-s5bnr") pod "8c5d2690-f2b3-4905-bae7-03e412bd39a1" (UID: "8c5d2690-f2b3-4905-bae7-03e412bd39a1"). InnerVolumeSpecName "kube-api-access-s5bnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:32:39.383859 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.383838 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-util" (OuterVolumeSpecName: "util") pod "8c5d2690-f2b3-4905-bae7-03e412bd39a1" (UID: "8c5d2690-f2b3-4905-bae7-03e412bd39a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:32:39.479453 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.479423 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-util\") pod \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " Jun 05 21:32:39.479626 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.479534 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-bundle\") pod \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " Jun 05 21:32:39.479626 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.479575 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnvkp\" (UniqueName: \"kubernetes.io/projected/661b9e7b-3d5f-4576-81e7-02bdfe23045e-kube-api-access-vnvkp\") pod \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\" (UID: \"661b9e7b-3d5f-4576-81e7-02bdfe23045e\") " Jun 05 21:32:39.479879 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.479862 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:39.479922 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.479913 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c5d2690-f2b3-4905-bae7-03e412bd39a1-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:39.479960 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.479928 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5bnr\" (UniqueName: \"kubernetes.io/projected/8c5d2690-f2b3-4905-bae7-03e412bd39a1-kube-api-access-s5bnr\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:39.480116 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.480088 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-bundle" (OuterVolumeSpecName: "bundle") pod "661b9e7b-3d5f-4576-81e7-02bdfe23045e" (UID: "661b9e7b-3d5f-4576-81e7-02bdfe23045e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:32:39.481760 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.481732 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/661b9e7b-3d5f-4576-81e7-02bdfe23045e-kube-api-access-vnvkp" (OuterVolumeSpecName: "kube-api-access-vnvkp") pod "661b9e7b-3d5f-4576-81e7-02bdfe23045e" (UID: "661b9e7b-3d5f-4576-81e7-02bdfe23045e"). InnerVolumeSpecName "kube-api-access-vnvkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:32:39.484984 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.484951 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-util" (OuterVolumeSpecName: "util") pod "661b9e7b-3d5f-4576-81e7-02bdfe23045e" (UID: "661b9e7b-3d5f-4576-81e7-02bdfe23045e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:32:39.581484 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.581442 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:39.581484 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.581480 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/661b9e7b-3d5f-4576-81e7-02bdfe23045e-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:39.581697 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:39.581496 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnvkp\" (UniqueName: \"kubernetes.io/projected/661b9e7b-3d5f-4576-81e7-02bdfe23045e-kube-api-access-vnvkp\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:32:40.156692 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:40.156654 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" Jun 05 21:32:40.157160 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:40.156662 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll" event={"ID":"8c5d2690-f2b3-4905-bae7-03e412bd39a1","Type":"ContainerDied","Data":"a81b620087e4f3beb5f1c41c6e29ce3465aa5f69b0a151af89e1ecaaa23f512d"} Jun 05 21:32:40.157160 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:40.156810 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a81b620087e4f3beb5f1c41c6e29ce3465aa5f69b0a151af89e1ecaaa23f512d" Jun 05 21:32:40.159380 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:40.159355 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" Jun 05 21:32:40.159380 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:40.159368 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l" event={"ID":"661b9e7b-3d5f-4576-81e7-02bdfe23045e","Type":"ContainerDied","Data":"1d341164958fcdc492f8a457d5fd9a071ffbab53eb9451132d330e82e38ff5c2"} Jun 05 21:32:40.159540 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:40.159414 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d341164958fcdc492f8a457d5fd9a071ffbab53eb9451132d330e82e38ff5c2" Jun 05 21:32:46.549984 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:46.549951 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:50.082652 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:50.082617 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:51.978726 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:51.978692 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:53.269778 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.269741 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258"] Jun 05 21:32:53.270277 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270256 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerName="pull" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270282 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerName="pull" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270299 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerName="pull" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270308 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerName="pull" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270320 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerName="extract" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270344 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerName="extract" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270356 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerName="pull" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270365 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerName="pull" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270376 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerName="extract" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270384 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerName="extract" Jun 05 21:32:53.270397 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270401 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerName="extract" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270409 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerName="extract" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270422 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerName="pull" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270430 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerName="pull" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270446 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerName="extract" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270455 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerName="extract" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270471 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerName="util" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270479 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerName="util" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270487 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerName="util" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270495 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerName="util" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270504 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerName="util" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270509 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerName="util" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270514 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerName="util" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270520 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerName="util" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270612 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="661b9e7b-3d5f-4576-81e7-02bdfe23045e" containerName="extract" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270627 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e78d5a6-35af-4674-9ee5-3ab40d051a4b" containerName="extract" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270639 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b" containerName="extract" Jun 05 21:32:53.270781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.270647 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c5d2690-f2b3-4905-bae7-03e412bd39a1" containerName="extract" Jun 05 21:32:53.273982 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.273963 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:32:53.276583 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.276560 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 21:32:53.276688 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.276608 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mcfxr\"" Jun 05 21:32:53.276688 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.276647 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 21:32:53.289746 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.289710 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258"] Jun 05 21:32:53.407187 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.407149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7cvk\" (UniqueName: \"kubernetes.io/projected/0d96fe55-9701-477f-aec1-35eb400d56b4-kube-api-access-s7cvk\") pod \"limitador-operator-controller-manager-859d7b78bd-5h258\" (UID: \"0d96fe55-9701-477f-aec1-35eb400d56b4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:32:53.508597 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.508549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7cvk\" (UniqueName: \"kubernetes.io/projected/0d96fe55-9701-477f-aec1-35eb400d56b4-kube-api-access-s7cvk\") pod \"limitador-operator-controller-manager-859d7b78bd-5h258\" (UID: \"0d96fe55-9701-477f-aec1-35eb400d56b4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:32:53.523607 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.523538 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7cvk\" (UniqueName: \"kubernetes.io/projected/0d96fe55-9701-477f-aec1-35eb400d56b4-kube-api-access-s7cvk\") pod \"limitador-operator-controller-manager-859d7b78bd-5h258\" (UID: \"0d96fe55-9701-477f-aec1-35eb400d56b4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:32:53.584500 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.584459 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:32:53.742622 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:53.742594 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258"] Jun 05 21:32:53.744249 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:32:53.744220 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d96fe55_9701_477f_aec1_35eb400d56b4.slice/crio-88532117fe18521c40dad8c981228ad2c8b37d9714702557bd52e2484e551cc5 WatchSource:0}: Error finding container 88532117fe18521c40dad8c981228ad2c8b37d9714702557bd52e2484e551cc5: Status 404 returned error can't find the container with id 88532117fe18521c40dad8c981228ad2c8b37d9714702557bd52e2484e551cc5 Jun 05 21:32:54.012525 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:54.012493 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:54.217300 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:54.217266 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:54.242406 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:54.242374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" event={"ID":"0d96fe55-9701-477f-aec1-35eb400d56b4","Type":"ContainerStarted","Data":"88532117fe18521c40dad8c981228ad2c8b37d9714702557bd52e2484e551cc5"} Jun 05 21:32:56.256841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:56.256807 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" event={"ID":"0d96fe55-9701-477f-aec1-35eb400d56b4","Type":"ContainerStarted","Data":"d46eeb905c70b43857b6b304a26c7cca6d3d0e67b4f28d061435812c8ec0c1d5"} Jun 05 21:32:56.257289 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:56.256865 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:32:56.274390 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:56.274321 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" podStartSLOduration=1.253877391 podStartE2EDuration="3.274304508s" totalImagesPullingTime="2.020427117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:32:56.272317573 +0000 UTC m=+861.340727499" watchObservedRunningTime="2026-06-05 21:32:56.274304508 +0000 UTC m=+861.342714507" Jun 05 21:32:56.351179 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:56.351141 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:56.629925 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:56.629826 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:56.759695 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:56.759664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:59.017708 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:59.017672 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:32:59.788314 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:32:59.788274 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:00.103096 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:00.103017 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:01.559004 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:01.558974 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:01.658935 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:01.658908 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:07.265436 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:07.265397 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:33:09.995125 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:09.995087 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:10.097197 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.097156 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:10.132801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.132765 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258"] Jun 05 21:33:10.133291 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.133251 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" containerName="manager" containerID="cri-o://d46eeb905c70b43857b6b304a26c7cca6d3d0e67b4f28d061435812c8ec0c1d5" gracePeriod=2 Jun 05 21:33:10.147116 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.147081 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258"] Jun 05 21:33:10.154878 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:33:10.154833 2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0d96fe55-9701-477f-aec1-35eb400d56b4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-5h258\": pods \"limitador-operator-controller-manager-859d7b78bd-5h258\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:33:10.160453 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.160419 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w"] Jun 05 21:33:10.161073 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.161051 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" containerName="manager" Jun 05 21:33:10.161182 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.161075 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" containerName="manager" Jun 05 21:33:10.161244 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.161183 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" containerName="manager" Jun 05 21:33:10.165164 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.165128 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" Jun 05 21:33:10.169627 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:33:10.169593 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5h258\" is forbidden: User \"system:node:ip-10-0-136-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-234.ec2.internal' and this object" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:33:10.203940 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.203907 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w"] Jun 05 21:33:10.257104 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.257068 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4v4r\" (UniqueName: \"kubernetes.io/projected/01911232-d4b0-4d8c-83f0-66655a37c4b4-kube-api-access-k4v4r\") pod \"limitador-operator-controller-manager-859d7b78bd-5n26w\" (UID: \"01911232-d4b0-4d8c-83f0-66655a37c4b4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" Jun 05 21:33:10.340618 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.340582 2567 generic.go:356] "Generic (PLEG): container finished" podID="0d96fe55-9701-477f-aec1-35eb400d56b4" containerID="d46eeb905c70b43857b6b304a26c7cca6d3d0e67b4f28d061435812c8ec0c1d5" exitCode=0 Jun 05 21:33:10.357763 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.357726 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4v4r\" (UniqueName: \"kubernetes.io/projected/01911232-d4b0-4d8c-83f0-66655a37c4b4-kube-api-access-k4v4r\") pod \"limitador-operator-controller-manager-859d7b78bd-5n26w\" (UID: \"01911232-d4b0-4d8c-83f0-66655a37c4b4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" Jun 05 21:33:10.366821 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.366789 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4v4r\" (UniqueName: \"kubernetes.io/projected/01911232-d4b0-4d8c-83f0-66655a37c4b4-kube-api-access-k4v4r\") pod \"limitador-operator-controller-manager-859d7b78bd-5n26w\" (UID: \"01911232-d4b0-4d8c-83f0-66655a37c4b4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" Jun 05 21:33:10.386512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.386488 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:33:10.388657 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:33:10.388627 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5h258\" is forbidden: User \"system:node:ip-10-0-136-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-234.ec2.internal' and this object" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:33:10.459183 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.459146 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7cvk\" (UniqueName: \"kubernetes.io/projected/0d96fe55-9701-477f-aec1-35eb400d56b4-kube-api-access-s7cvk\") pod \"0d96fe55-9701-477f-aec1-35eb400d56b4\" (UID: \"0d96fe55-9701-477f-aec1-35eb400d56b4\") " Jun 05 21:33:10.461248 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.461220 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d96fe55-9701-477f-aec1-35eb400d56b4-kube-api-access-s7cvk" (OuterVolumeSpecName: "kube-api-access-s7cvk") pod "0d96fe55-9701-477f-aec1-35eb400d56b4" (UID: "0d96fe55-9701-477f-aec1-35eb400d56b4"). InnerVolumeSpecName "kube-api-access-s7cvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:33:10.536361 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.536246 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" Jun 05 21:33:10.560838 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.560809 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7cvk\" (UniqueName: \"kubernetes.io/projected/0d96fe55-9701-477f-aec1-35eb400d56b4-kube-api-access-s7cvk\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:33:10.675857 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:10.675830 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w"] Jun 05 21:33:10.676760 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:33:10.676733 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01911232_d4b0_4d8c_83f0_66655a37c4b4.slice/crio-b253885db77551e10d2edbb6ea9159e9535183a7b98261faf6fb4669dc968ea2 WatchSource:0}: Error finding container b253885db77551e10d2edbb6ea9159e9535183a7b98261faf6fb4669dc968ea2: Status 404 returned error can't find the container with id b253885db77551e10d2edbb6ea9159e9535183a7b98261faf6fb4669dc968ea2 Jun 05 21:33:11.215821 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.215777 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4"] Jun 05 21:33:11.219620 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.219597 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:11.224694 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:33:11.224657 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5h258\" is forbidden: User \"system:node:ip-10-0-136-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-234.ec2.internal' and this object" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:33:11.225500 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.225480 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9gd29\"" Jun 05 21:33:11.238343 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.238299 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4"] Jun 05 21:33:11.267576 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.267541 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ee09312-76b4-43bd-9884-2c90cd8cd366-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6fnh4\" (UID: \"1ee09312-76b4-43bd-9884-2c90cd8cd366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:11.267772 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.267650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5lwb\" (UniqueName: \"kubernetes.io/projected/1ee09312-76b4-43bd-9884-2c90cd8cd366-kube-api-access-v5lwb\") pod \"kuadrant-operator-controller-manager-86878c769f-6fnh4\" (UID: \"1ee09312-76b4-43bd-9884-2c90cd8cd366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:11.349432 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.349397 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" event={"ID":"01911232-d4b0-4d8c-83f0-66655a37c4b4","Type":"ContainerStarted","Data":"492fded00eccc8594f827c61a0b1fd581b5d330fa024f469bccea85614701d50"} Jun 05 21:33:11.349617 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.349455 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" event={"ID":"01911232-d4b0-4d8c-83f0-66655a37c4b4","Type":"ContainerStarted","Data":"b253885db77551e10d2edbb6ea9159e9535183a7b98261faf6fb4669dc968ea2"} Jun 05 21:33:11.349617 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.349483 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" Jun 05 21:33:11.350830 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.350812 2567 scope.go:117] "RemoveContainer" containerID="d46eeb905c70b43857b6b304a26c7cca6d3d0e67b4f28d061435812c8ec0c1d5" Jun 05 21:33:11.350936 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.350815 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:33:11.369158 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.369128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ee09312-76b4-43bd-9884-2c90cd8cd366-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6fnh4\" (UID: \"1ee09312-76b4-43bd-9884-2c90cd8cd366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:11.369291 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.369275 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5lwb\" (UniqueName: \"kubernetes.io/projected/1ee09312-76b4-43bd-9884-2c90cd8cd366-kube-api-access-v5lwb\") pod \"kuadrant-operator-controller-manager-86878c769f-6fnh4\" (UID: \"1ee09312-76b4-43bd-9884-2c90cd8cd366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:11.369522 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.369503 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ee09312-76b4-43bd-9884-2c90cd8cd366-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6fnh4\" (UID: \"1ee09312-76b4-43bd-9884-2c90cd8cd366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:11.374622 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.374496 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" podStartSLOduration=1.374479975 podStartE2EDuration="1.374479975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:33:11.374192533 +0000 UTC m=+876.442602433" watchObservedRunningTime="2026-06-05 21:33:11.374479975 +0000 UTC m=+876.442889875" Jun 05 21:33:11.376471 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:33:11.376445 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5h258\" is forbidden: User \"system:node:ip-10-0-136-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-234.ec2.internal' and this object" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:33:11.378581 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:33:11.378554 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-5h258\" is forbidden: User \"system:node:ip-10-0-136-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-234.ec2.internal' and this object" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5h258" Jun 05 21:33:11.386183 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.386158 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5lwb\" (UniqueName: \"kubernetes.io/projected/1ee09312-76b4-43bd-9884-2c90cd8cd366-kube-api-access-v5lwb\") pod \"kuadrant-operator-controller-manager-86878c769f-6fnh4\" (UID: \"1ee09312-76b4-43bd-9884-2c90cd8cd366\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:11.438677 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.438598 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d96fe55-9701-477f-aec1-35eb400d56b4" path="/var/lib/kubelet/pods/0d96fe55-9701-477f-aec1-35eb400d56b4/volumes" Jun 05 21:33:11.529893 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.529851 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:11.670763 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:11.670738 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4"] Jun 05 21:33:11.673260 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:33:11.673228 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee09312_76b4_43bd_9884_2c90cd8cd366.slice/crio-7f16928e12cd71773e2a6728e4c190f30e71d2761d79fe95b3ac16e7c5b34f03 WatchSource:0}: Error finding container 7f16928e12cd71773e2a6728e4c190f30e71d2761d79fe95b3ac16e7c5b34f03: Status 404 returned error can't find the container with id 7f16928e12cd71773e2a6728e4c190f30e71d2761d79fe95b3ac16e7c5b34f03 Jun 05 21:33:12.361812 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:12.361777 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" event={"ID":"1ee09312-76b4-43bd-9884-2c90cd8cd366","Type":"ContainerStarted","Data":"7f16928e12cd71773e2a6728e4c190f30e71d2761d79fe95b3ac16e7c5b34f03"} Jun 05 21:33:12.435156 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:12.435109 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:12.535505 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:12.535473 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:16.390841 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:16.390805 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" event={"ID":"1ee09312-76b4-43bd-9884-2c90cd8cd366","Type":"ContainerStarted","Data":"afd862855dae354ed8e1bfac4ce92e4a9437faeed187e783654bef6db5bf30d2"} Jun 05 21:33:16.391353 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:16.390894 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:16.413250 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:16.413198 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" podStartSLOduration=1.672187246 podStartE2EDuration="5.413182463s" totalImagesPullingTime="3.740995217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:33:16.411692823 +0000 UTC m=+881.480102724" watchObservedRunningTime="2026-06-05 21:33:16.413182463 +0000 UTC m=+881.481592359" Jun 05 21:33:16.737467 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:16.737381 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:18.998538 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:18.998504 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:19.087654 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:19.087617 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:22.365776 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:22.365747 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5n26w" Jun 05 21:33:23.246837 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:23.246805 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:23.344613 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:23.344566 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:27.399882 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:27.399849 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6fnh4" Jun 05 21:33:30.393154 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:30.393121 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:30.494524 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:30.494493 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:32.828919 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:32.828884 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:33.835876 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:33.835842 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:38.276153 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:38.276118 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:38.376478 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:38.376429 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:39.404568 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:39.404527 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:39.504378 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:39.504318 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:43.720384 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:43.720315 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:43.819094 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:43.819051 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:47.469842 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:47.469807 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:47.578923 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:47.578858 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:47.644052 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:47.644018 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:47.873671 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:47.873623 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:47.976712 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:47.976679 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:48.037738 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:48.037700 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:48.740452 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:48.740412 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:48.836079 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:33:48.836047 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:08.901103 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:08.901057 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:09.000810 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:09.000775 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:09.249456 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:09.249418 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:19.167969 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:19.167932 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:19.266707 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:19.266657 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:19.408952 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:19.408907 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:20.426380 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.426348 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp"] Jun 05 21:34:20.430223 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.430205 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.433213 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.433182 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 21:34:20.433213 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.433157 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 21:34:20.433434 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.433307 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qx4hd\"" Jun 05 21:34:20.441096 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.441070 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp"] Jun 05 21:34:20.532595 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.532548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.532777 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.532622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k862b\" (UniqueName: \"kubernetes.io/projected/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-kube-api-access-k862b\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.532777 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.532657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.633609 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.633564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k862b\" (UniqueName: \"kubernetes.io/projected/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-kube-api-access-k862b\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.633796 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.633722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.633840 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.633807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.634125 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.634108 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.634196 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.634181 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.644187 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.644154 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k862b\" (UniqueName: \"kubernetes.io/projected/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-kube-api-access-k862b\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.740631 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.740521 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:20.878954 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:20.878920 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp"] Jun 05 21:34:20.880053 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:34:20.880025 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd974ee7_dcdb_41f6_b230_c97d5f65ed94.slice/crio-8830805fa7b45dd362762218d8f4f6c0593bad42be6e2fcbc1a795e9754f8473 WatchSource:0}: Error finding container 8830805fa7b45dd362762218d8f4f6c0593bad42be6e2fcbc1a795e9754f8473: Status 404 returned error can't find the container with id 8830805fa7b45dd362762218d8f4f6c0593bad42be6e2fcbc1a795e9754f8473 Jun 05 21:34:21.789071 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:21.789035 2567 generic.go:356] "Generic (PLEG): container finished" podID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerID="fbfc399893014c89757d1075dbb00922461f3690abd4fc29d563ebf7d09c375a" exitCode=0 Jun 05 21:34:21.789478 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:21.789125 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" event={"ID":"bd974ee7-dcdb-41f6-b230-c97d5f65ed94","Type":"ContainerDied","Data":"fbfc399893014c89757d1075dbb00922461f3690abd4fc29d563ebf7d09c375a"} Jun 05 21:34:21.789478 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:21.789186 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" event={"ID":"bd974ee7-dcdb-41f6-b230-c97d5f65ed94","Type":"ContainerStarted","Data":"8830805fa7b45dd362762218d8f4f6c0593bad42be6e2fcbc1a795e9754f8473"} Jun 05 21:34:22.796808 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:22.796775 2567 generic.go:356] "Generic (PLEG): container finished" podID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerID="2c632ca5cd7aff7ca58b7cd66db3244de9dac8baa5c89dfa89b659564b17c765" exitCode=0 Jun 05 21:34:22.797226 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:22.796853 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" event={"ID":"bd974ee7-dcdb-41f6-b230-c97d5f65ed94","Type":"ContainerDied","Data":"2c632ca5cd7aff7ca58b7cd66db3244de9dac8baa5c89dfa89b659564b17c765"} Jun 05 21:34:23.806973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:23.806929 2567 generic.go:356] "Generic (PLEG): container finished" podID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerID="2b95a113fe3d86518953d76371375883c6f445d3905db3c520e899b74dcaf50d" exitCode=0 Jun 05 21:34:23.807489 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:23.807115 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" event={"ID":"bd974ee7-dcdb-41f6-b230-c97d5f65ed94","Type":"ContainerDied","Data":"2b95a113fe3d86518953d76371375883c6f445d3905db3c520e899b74dcaf50d"} Jun 05 21:34:24.964106 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:24.964077 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:25.075642 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.075544 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-util\") pod \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " Jun 05 21:34:25.075642 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.075611 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-bundle\") pod \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " Jun 05 21:34:25.075899 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.075666 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k862b\" (UniqueName: \"kubernetes.io/projected/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-kube-api-access-k862b\") pod \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\" (UID: \"bd974ee7-dcdb-41f6-b230-c97d5f65ed94\") " Jun 05 21:34:25.076191 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.076167 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-bundle" (OuterVolumeSpecName: "bundle") pod "bd974ee7-dcdb-41f6-b230-c97d5f65ed94" (UID: "bd974ee7-dcdb-41f6-b230-c97d5f65ed94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:34:25.077874 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.077846 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-kube-api-access-k862b" (OuterVolumeSpecName: "kube-api-access-k862b") pod "bd974ee7-dcdb-41f6-b230-c97d5f65ed94" (UID: "bd974ee7-dcdb-41f6-b230-c97d5f65ed94"). InnerVolumeSpecName "kube-api-access-k862b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:34:25.081611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.081574 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-util" (OuterVolumeSpecName: "util") pod "bd974ee7-dcdb-41f6-b230-c97d5f65ed94" (UID: "bd974ee7-dcdb-41f6-b230-c97d5f65ed94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:34:25.176512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.176474 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-bundle\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:34:25.176512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.176508 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k862b\" (UniqueName: \"kubernetes.io/projected/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-kube-api-access-k862b\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:34:25.176512 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.176522 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd974ee7-dcdb-41f6-b230-c97d5f65ed94-util\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:34:25.822442 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.822406 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" Jun 05 21:34:25.822635 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.822415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70gcjwp" event={"ID":"bd974ee7-dcdb-41f6-b230-c97d5f65ed94","Type":"ContainerDied","Data":"8830805fa7b45dd362762218d8f4f6c0593bad42be6e2fcbc1a795e9754f8473"} Jun 05 21:34:25.822635 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:25.822531 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8830805fa7b45dd362762218d8f4f6c0593bad42be6e2fcbc1a795e9754f8473" Jun 05 21:34:27.198307 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:27.198269 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:27.398271 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:27.398241 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:42.992578 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:42.992498 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:43.092200 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.092165 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:34:43.294833 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.294794 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:34:43.295216 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.295204 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerName="util" Jun 05 21:34:43.295268 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.295217 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerName="util" Jun 05 21:34:43.295268 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.295235 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerName="pull" Jun 05 21:34:43.295268 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.295241 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerName="pull" Jun 05 21:34:43.295268 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.295256 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerName="extract" Jun 05 21:34:43.295268 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.295261 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerName="extract" Jun 05 21:34:43.295454 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.295349 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd974ee7-dcdb-41f6-b230-c97d5f65ed94" containerName="extract" Jun 05 21:34:43.298887 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.298869 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:34:43.301575 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.301556 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2p9gp\"" Jun 05 21:34:43.301692 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.301620 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 21:34:43.302644 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.302628 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 21:34:43.302753 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.302683 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 21:34:43.308462 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.308407 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:34:43.457259 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.457222 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgb5\" (UniqueName: \"kubernetes.io/projected/e6232484-5516-4010-abe0-f06fbf18d19a-kube-api-access-fkgb5\") pod \"maas-keycloak-0\" (UID: \"e6232484-5516-4010-abe0-f06fbf18d19a\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:34:43.558783 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.558696 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgb5\" (UniqueName: \"kubernetes.io/projected/e6232484-5516-4010-abe0-f06fbf18d19a-kube-api-access-fkgb5\") pod \"maas-keycloak-0\" (UID: \"e6232484-5516-4010-abe0-f06fbf18d19a\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:34:43.567291 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.567262 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgb5\" (UniqueName: \"kubernetes.io/projected/e6232484-5516-4010-abe0-f06fbf18d19a-kube-api-access-fkgb5\") pod \"maas-keycloak-0\" (UID: \"e6232484-5516-4010-abe0-f06fbf18d19a\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:34:43.611103 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.611064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:34:43.749098 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:34:43.749071 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6232484_5516_4010_abe0_f06fbf18d19a.slice/crio-8c65d3140694a2b4b500235eaa3791e00cfed5c3bca381269e452309527c88b1 WatchSource:0}: Error finding container 8c65d3140694a2b4b500235eaa3791e00cfed5c3bca381269e452309527c88b1: Status 404 returned error can't find the container with id 8c65d3140694a2b4b500235eaa3791e00cfed5c3bca381269e452309527c88b1 Jun 05 21:34:43.749262 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.749207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:34:43.935256 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:43.935166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e6232484-5516-4010-abe0-f06fbf18d19a","Type":"ContainerStarted","Data":"8c65d3140694a2b4b500235eaa3791e00cfed5c3bca381269e452309527c88b1"} Jun 05 21:34:48.978049 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:48.977946 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e6232484-5516-4010-abe0-f06fbf18d19a","Type":"ContainerStarted","Data":"f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808"} Jun 05 21:34:48.998789 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:48.998724 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.10406813 podStartE2EDuration="5.998707077s" totalImagesPullingTime="4.894638947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:34:48.996604495 +0000 UTC m=+974.065014396" watchObservedRunningTime="2026-06-05 21:34:48.998707077 +0000 UTC m=+974.067116977" Jun 05 21:34:49.611177 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:49.611134 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 21:34:49.612783 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:49.612740 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:50.612031 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:50.611975 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:51.611680 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:51.611630 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:52.611640 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:52.611589 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:53.612198 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:53.611448 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 21:34:53.612198 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:53.611782 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:54.611895 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:54.611844 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:55.612585 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:55.612527 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:56.611688 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:56.611641 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:57.611784 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:57.611734 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:58.611975 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:58.611917 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:34:59.612525 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:34:59.612468 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:35:00.609393 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:00.609287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:00.612454 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:00.612419 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:35:01.611785 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:01.611728 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.53:9000/health/started\": dial tcp 10.132.0.53:9000: connect: connection refused" Jun 05 21:35:02.726307 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:02.726255 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 21:35:02.747638 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:02.747581 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:35:12.731884 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:12.731848 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 21:35:13.389998 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:13.389967 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:13.846075 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:13.846042 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:18.892962 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:18.892887 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:18.901781 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:18.901748 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75d64fd7db-xgxtc"] Jun 05 21:35:18.974908 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:18.974873 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75d64fd7db-xgxtc"] Jun 05 21:35:18.975089 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:18.974973 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:18.977857 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:18.977826 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 05 21:35:18.977857 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:18.977836 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 21:35:18.978109 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:18.978091 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cj8fs\"" Jun 05 21:35:18.985134 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:18.985108 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:19.079101 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.079066 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:19.084349 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.084309 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d86955579-tx2xf"] Jun 05 21:35:19.102801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.102773 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d86955579-tx2xf"] Jun 05 21:35:19.102988 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.102910 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:19.132207 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.132170 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8eec098-52fb-486b-9a65-cfe38bf4d996-webhook-cert\") pod \"maas-controller-75d64fd7db-xgxtc\" (UID: \"f8eec098-52fb-486b-9a65-cfe38bf4d996\") " pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:19.132422 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.132370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6cgb\" (UniqueName: \"kubernetes.io/projected/f8eec098-52fb-486b-9a65-cfe38bf4d996-kube-api-access-z6cgb\") pod \"maas-controller-75d64fd7db-xgxtc\" (UID: \"f8eec098-52fb-486b-9a65-cfe38bf4d996\") " pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:19.140613 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.140590 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:19.232983 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.232895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a51a4a8e-8fe9-46bd-a882-e5e9018e8a07-webhook-cert\") pod \"maas-controller-6d86955579-tx2xf\" (UID: \"a51a4a8e-8fe9-46bd-a882-e5e9018e8a07\") " pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:19.232983 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.232941 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6cgb\" (UniqueName: \"kubernetes.io/projected/f8eec098-52fb-486b-9a65-cfe38bf4d996-kube-api-access-z6cgb\") pod \"maas-controller-75d64fd7db-xgxtc\" (UID: \"f8eec098-52fb-486b-9a65-cfe38bf4d996\") " pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:19.233187 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.232997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8eec098-52fb-486b-9a65-cfe38bf4d996-webhook-cert\") pod \"maas-controller-75d64fd7db-xgxtc\" (UID: \"f8eec098-52fb-486b-9a65-cfe38bf4d996\") " pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:19.233187 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.233117 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z97lr\" (UniqueName: \"kubernetes.io/projected/a51a4a8e-8fe9-46bd-a882-e5e9018e8a07-kube-api-access-z97lr\") pod \"maas-controller-6d86955579-tx2xf\" (UID: \"a51a4a8e-8fe9-46bd-a882-e5e9018e8a07\") " pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:19.235431 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.235408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8eec098-52fb-486b-9a65-cfe38bf4d996-webhook-cert\") pod \"maas-controller-75d64fd7db-xgxtc\" (UID: \"f8eec098-52fb-486b-9a65-cfe38bf4d996\") " pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:19.241511 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.241485 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6cgb\" (UniqueName: \"kubernetes.io/projected/f8eec098-52fb-486b-9a65-cfe38bf4d996-kube-api-access-z6cgb\") pod \"maas-controller-75d64fd7db-xgxtc\" (UID: \"f8eec098-52fb-486b-9a65-cfe38bf4d996\") " pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:19.286321 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.286276 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:19.334295 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.334263 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z97lr\" (UniqueName: \"kubernetes.io/projected/a51a4a8e-8fe9-46bd-a882-e5e9018e8a07-kube-api-access-z97lr\") pod \"maas-controller-6d86955579-tx2xf\" (UID: \"a51a4a8e-8fe9-46bd-a882-e5e9018e8a07\") " pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:19.334493 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.334387 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a51a4a8e-8fe9-46bd-a882-e5e9018e8a07-webhook-cert\") pod \"maas-controller-6d86955579-tx2xf\" (UID: \"a51a4a8e-8fe9-46bd-a882-e5e9018e8a07\") " pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:19.336895 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.336868 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a51a4a8e-8fe9-46bd-a882-e5e9018e8a07-webhook-cert\") pod \"maas-controller-6d86955579-tx2xf\" (UID: \"a51a4a8e-8fe9-46bd-a882-e5e9018e8a07\") " pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:19.342452 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.342427 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z97lr\" (UniqueName: \"kubernetes.io/projected/a51a4a8e-8fe9-46bd-a882-e5e9018e8a07-kube-api-access-z97lr\") pod \"maas-controller-6d86955579-tx2xf\" (UID: \"a51a4a8e-8fe9-46bd-a882-e5e9018e8a07\") " pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:19.413710 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.413669 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:19.450897 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.450867 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75d64fd7db-xgxtc"] Jun 05 21:35:19.452710 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:35:19.452687 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8eec098_52fb_486b_9a65_cfe38bf4d996.slice/crio-c876047aa7f30e10af4562dab8058f7aa52e172b422e977022c3d3abeff3d09a WatchSource:0}: Error finding container c876047aa7f30e10af4562dab8058f7aa52e172b422e977022c3d3abeff3d09a: Status 404 returned error can't find the container with id c876047aa7f30e10af4562dab8058f7aa52e172b422e977022c3d3abeff3d09a Jun 05 21:35:19.453913 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.453896 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:35:19.579223 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:19.579195 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d86955579-tx2xf"] Jun 05 21:35:19.580640 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:35:19.580606 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51a4a8e_8fe9_46bd_a882_e5e9018e8a07.slice/crio-8e5468b68448fef0305b406a7fd87723b9f2560aee0458f1f40ec762dbdb8b04 WatchSource:0}: Error finding container 8e5468b68448fef0305b406a7fd87723b9f2560aee0458f1f40ec762dbdb8b04: Status 404 returned error can't find the container with id 8e5468b68448fef0305b406a7fd87723b9f2560aee0458f1f40ec762dbdb8b04 Jun 05 21:35:20.220429 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:20.220384 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" event={"ID":"f8eec098-52fb-486b-9a65-cfe38bf4d996","Type":"ContainerStarted","Data":"c876047aa7f30e10af4562dab8058f7aa52e172b422e977022c3d3abeff3d09a"} Jun 05 21:35:20.223087 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:20.223053 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d86955579-tx2xf" event={"ID":"a51a4a8e-8fe9-46bd-a882-e5e9018e8a07","Type":"ContainerStarted","Data":"8e5468b68448fef0305b406a7fd87723b9f2560aee0458f1f40ec762dbdb8b04"} Jun 05 21:35:22.403483 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:22.403446 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:22.501838 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:22.501805 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:23.248729 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:23.248682 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d86955579-tx2xf" event={"ID":"a51a4a8e-8fe9-46bd-a882-e5e9018e8a07","Type":"ContainerStarted","Data":"e43b47fad941850835a6aaa828f218aabbe8a018c2ce31c5ef25cf90f61da60c"} Jun 05 21:35:23.248959 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:23.248759 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:23.250432 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:23.250395 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" event={"ID":"f8eec098-52fb-486b-9a65-cfe38bf4d996","Type":"ContainerStarted","Data":"78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38"} Jun 05 21:35:23.250568 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:23.250552 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:23.271149 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:23.271088 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d86955579-tx2xf" podStartSLOduration=1.686267097 podStartE2EDuration="4.271070494s" totalImagesPullingTime="2.584803397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:35:23.268379015 +0000 UTC m=+1008.336788915" watchObservedRunningTime="2026-06-05 21:35:23.271070494 +0000 UTC m=+1008.339480405" Jun 05 21:35:23.288628 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:23.288580 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" podStartSLOduration=2.567924827 podStartE2EDuration="5.288563947s" totalImagesPullingTime="2.72063912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:35:23.285247511 +0000 UTC m=+1008.353657423" watchObservedRunningTime="2026-06-05 21:35:23.288563947 +0000 UTC m=+1008.356973846" Jun 05 21:35:34.276294 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.276256 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d86955579-tx2xf" Jun 05 21:35:34.276812 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.276381 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:34.342801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.342758 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75d64fd7db-xgxtc"] Jun 05 21:35:34.343035 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.343011 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" podUID="f8eec098-52fb-486b-9a65-cfe38bf4d996" containerName="manager" containerID="cri-o://78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38" gracePeriod=30 Jun 05 21:35:34.601022 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.600994 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:34.673238 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.673194 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8eec098-52fb-486b-9a65-cfe38bf4d996-webhook-cert\") pod \"f8eec098-52fb-486b-9a65-cfe38bf4d996\" (UID: \"f8eec098-52fb-486b-9a65-cfe38bf4d996\") " Jun 05 21:35:34.673238 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.673246 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6cgb\" (UniqueName: \"kubernetes.io/projected/f8eec098-52fb-486b-9a65-cfe38bf4d996-kube-api-access-z6cgb\") pod \"f8eec098-52fb-486b-9a65-cfe38bf4d996\" (UID: \"f8eec098-52fb-486b-9a65-cfe38bf4d996\") " Jun 05 21:35:34.675490 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.675454 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8eec098-52fb-486b-9a65-cfe38bf4d996-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f8eec098-52fb-486b-9a65-cfe38bf4d996" (UID: "f8eec098-52fb-486b-9a65-cfe38bf4d996"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:35:34.675611 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.675464 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8eec098-52fb-486b-9a65-cfe38bf4d996-kube-api-access-z6cgb" (OuterVolumeSpecName: "kube-api-access-z6cgb") pod "f8eec098-52fb-486b-9a65-cfe38bf4d996" (UID: "f8eec098-52fb-486b-9a65-cfe38bf4d996"). InnerVolumeSpecName "kube-api-access-z6cgb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:35:34.774595 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.774552 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8eec098-52fb-486b-9a65-cfe38bf4d996-webhook-cert\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:35:34.774595 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:34.774590 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6cgb\" (UniqueName: \"kubernetes.io/projected/f8eec098-52fb-486b-9a65-cfe38bf4d996-kube-api-access-z6cgb\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:35:35.329551 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.329509 2567 generic.go:356] "Generic (PLEG): container finished" podID="f8eec098-52fb-486b-9a65-cfe38bf4d996" containerID="78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38" exitCode=0 Jun 05 21:35:35.329961 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.329579 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" Jun 05 21:35:35.329961 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.329595 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" event={"ID":"f8eec098-52fb-486b-9a65-cfe38bf4d996","Type":"ContainerDied","Data":"78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38"} Jun 05 21:35:35.329961 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.329676 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75d64fd7db-xgxtc" event={"ID":"f8eec098-52fb-486b-9a65-cfe38bf4d996","Type":"ContainerDied","Data":"c876047aa7f30e10af4562dab8058f7aa52e172b422e977022c3d3abeff3d09a"} Jun 05 21:35:35.329961 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.329699 2567 scope.go:117] "RemoveContainer" containerID="78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38" Jun 05 21:35:35.339853 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.339833 2567 scope.go:117] "RemoveContainer" containerID="78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38" Jun 05 21:35:35.340187 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:35:35.340167 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38\": container with ID starting with 78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38 not found: ID does not exist" containerID="78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38" Jun 05 21:35:35.340237 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.340196 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38"} err="failed to get container status \"78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38\": rpc error: code = NotFound desc = could not find container \"78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38\": container with ID starting with 78d6b37142477f5a76495b2a81323c42dc8554762804621067668206cc43bd38 not found: ID does not exist" Jun 05 21:35:35.353471 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.353437 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75d64fd7db-xgxtc"] Jun 05 21:35:35.357079 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.357049 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75d64fd7db-xgxtc"] Jun 05 21:35:35.439599 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:35.439569 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8eec098-52fb-486b-9a65-cfe38bf4d996" path="/var/lib/kubelet/pods/f8eec098-52fb-486b-9a65-cfe38bf4d996/volumes" Jun 05 21:35:37.792442 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:37.792404 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:52.707230 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:52.707181 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:53.185360 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:53.185315 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:53.284480 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:53.284440 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:35:53.394321 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:35:53.394286 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:36:05.035122 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:05.035093 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:36:05.095270 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:05.095235 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:36:05.151519 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:05.151485 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:36:05.151753 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:05.151719 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" containerID="cri-o://f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808" gracePeriod=30 Jun 05 21:36:07.206372 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.206347 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:07.271676 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.271644 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkgb5\" (UniqueName: \"kubernetes.io/projected/e6232484-5516-4010-abe0-f06fbf18d19a-kube-api-access-fkgb5\") pod \"e6232484-5516-4010-abe0-f06fbf18d19a\" (UID: \"e6232484-5516-4010-abe0-f06fbf18d19a\") " Jun 05 21:36:07.274036 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.274001 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6232484-5516-4010-abe0-f06fbf18d19a-kube-api-access-fkgb5" (OuterVolumeSpecName: "kube-api-access-fkgb5") pod "e6232484-5516-4010-abe0-f06fbf18d19a" (UID: "e6232484-5516-4010-abe0-f06fbf18d19a"). InnerVolumeSpecName "kube-api-access-fkgb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:36:07.372723 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.372632 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkgb5\" (UniqueName: \"kubernetes.io/projected/e6232484-5516-4010-abe0-f06fbf18d19a-kube-api-access-fkgb5\") on node \"ip-10-0-136-234.ec2.internal\" DevicePath \"\"" Jun 05 21:36:07.531322 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.531287 2567 generic.go:356] "Generic (PLEG): container finished" podID="e6232484-5516-4010-abe0-f06fbf18d19a" containerID="f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808" exitCode=143 Jun 05 21:36:07.531518 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.531353 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:07.531518 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.531376 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e6232484-5516-4010-abe0-f06fbf18d19a","Type":"ContainerDied","Data":"f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808"} Jun 05 21:36:07.531518 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.531429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e6232484-5516-4010-abe0-f06fbf18d19a","Type":"ContainerDied","Data":"8c65d3140694a2b4b500235eaa3791e00cfed5c3bca381269e452309527c88b1"} Jun 05 21:36:07.531518 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.531449 2567 scope.go:117] "RemoveContainer" containerID="f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808" Jun 05 21:36:07.541941 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.541925 2567 scope.go:117] "RemoveContainer" containerID="f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808" Jun 05 21:36:07.542212 ip-10-0-136-234 kubenswrapper[2567]: E0605 21:36:07.542195 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808\": container with ID starting with f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808 not found: ID does not exist" containerID="f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808" Jun 05 21:36:07.542264 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.542220 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808"} err="failed to get container status \"f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808\": rpc error: code = NotFound desc = could not find container \"f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808\": container with ID starting with f3bc4440fa9aece32b6217343ff0fdbd1881fa7d31c525607f265bf97df59808 not found: ID does not exist" Jun 05 21:36:07.551163 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.551133 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:36:07.553757 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.553735 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:36:07.578530 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.578498 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:36:07.579099 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.579075 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" Jun 05 21:36:07.579099 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.579098 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" Jun 05 21:36:07.579286 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.579152 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8eec098-52fb-486b-9a65-cfe38bf4d996" containerName="manager" Jun 05 21:36:07.579286 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.579162 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8eec098-52fb-486b-9a65-cfe38bf4d996" containerName="manager" Jun 05 21:36:07.579440 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.579295 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" containerName="keycloak" Jun 05 21:36:07.579440 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.579315 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8eec098-52fb-486b-9a65-cfe38bf4d996" containerName="manager" Jun 05 21:36:07.584021 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.583999 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:07.586646 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.586626 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 21:36:07.586956 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.586936 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 21:36:07.587051 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.587004 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 21:36:07.587118 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.587097 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 05 21:36:07.587926 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.587909 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2p9gp\"" Jun 05 21:36:07.593171 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.592925 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:36:07.675986 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.675874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld7l5\" (UniqueName: \"kubernetes.io/projected/a08d7b7c-e2c6-44cc-983e-8bedf34bbe82-kube-api-access-ld7l5\") pod \"maas-keycloak-0\" (UID: \"a08d7b7c-e2c6-44cc-983e-8bedf34bbe82\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:07.675986 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.675958 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a08d7b7c-e2c6-44cc-983e-8bedf34bbe82-test-realms\") pod \"maas-keycloak-0\" (UID: \"a08d7b7c-e2c6-44cc-983e-8bedf34bbe82\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:07.776610 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.776574 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a08d7b7c-e2c6-44cc-983e-8bedf34bbe82-test-realms\") pod \"maas-keycloak-0\" (UID: \"a08d7b7c-e2c6-44cc-983e-8bedf34bbe82\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:07.776824 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.776691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld7l5\" (UniqueName: \"kubernetes.io/projected/a08d7b7c-e2c6-44cc-983e-8bedf34bbe82-kube-api-access-ld7l5\") pod \"maas-keycloak-0\" (UID: \"a08d7b7c-e2c6-44cc-983e-8bedf34bbe82\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:07.777292 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.777271 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a08d7b7c-e2c6-44cc-983e-8bedf34bbe82-test-realms\") pod \"maas-keycloak-0\" (UID: \"a08d7b7c-e2c6-44cc-983e-8bedf34bbe82\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:07.792786 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.792755 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld7l5\" (UniqueName: \"kubernetes.io/projected/a08d7b7c-e2c6-44cc-983e-8bedf34bbe82-kube-api-access-ld7l5\") pod \"maas-keycloak-0\" (UID: \"a08d7b7c-e2c6-44cc-983e-8bedf34bbe82\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:07.896372 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:07.896305 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:08.037035 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:08.037005 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:36:08.037888 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:36:08.037852 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08d7b7c_e2c6_44cc_983e_8bedf34bbe82.slice/crio-5ccd7ece384681fdef21365ee34025d61404f66a526f60d983ba0a4888ae3d06 WatchSource:0}: Error finding container 5ccd7ece384681fdef21365ee34025d61404f66a526f60d983ba0a4888ae3d06: Status 404 returned error can't find the container with id 5ccd7ece384681fdef21365ee34025d61404f66a526f60d983ba0a4888ae3d06 Jun 05 21:36:08.541402 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:08.541363 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a08d7b7c-e2c6-44cc-983e-8bedf34bbe82","Type":"ContainerStarted","Data":"fe0ed81dfc70d4f6ad1fe96d2d1fa2fa5d1f0eaa5280f33811cc8b07bfc2a7fc"} Jun 05 21:36:08.541788 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:08.541421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a08d7b7c-e2c6-44cc-983e-8bedf34bbe82","Type":"ContainerStarted","Data":"5ccd7ece384681fdef21365ee34025d61404f66a526f60d983ba0a4888ae3d06"} Jun 05 21:36:08.561738 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:08.561687 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.2195557830000001 podStartE2EDuration="1.561668228s" totalImagesPullingTime="342.112445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:36:08.559885474 +0000 UTC m=+1053.628295372" watchObservedRunningTime="2026-06-05 21:36:08.561668228 +0000 UTC m=+1053.630078128" Jun 05 21:36:08.896828 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:08.896789 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:08.898750 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:08.898703 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:09.441400 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:09.441364 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6232484-5516-4010-abe0-f06fbf18d19a" path="/var/lib/kubelet/pods/e6232484-5516-4010-abe0-f06fbf18d19a/volumes" Jun 05 21:36:09.896865 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:09.896811 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:10.897865 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:10.897812 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:11.896864 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:11.896811 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:12.897938 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:12.897390 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:13.896914 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:13.896859 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:14.897476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:14.897423 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:15.897567 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:15.897516 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:16.896814 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:16.896770 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:17.896761 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:17.896716 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:17.897173 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:17.897023 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:18.896821 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:18.896714 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:19.897344 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:19.897281 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:20.897290 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:20.897236 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.56:9000/health/started\": dial tcp 10.132.0.56:9000: connect: connection refused" Jun 05 21:36:22.015965 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:22.015924 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:22.031030 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:22.030982 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:36:32.021195 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:32.021141 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a08d7b7c-e2c6-44cc-983e-8bedf34bbe82" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:36:42.021735 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:42.021698 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 21:36:54.237858 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:54.237815 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:36:54.337242 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:54.337205 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:36:58.947742 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:58.947690 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:36:59.018521 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:36:59.018477 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:37:06.405297 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.405262 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt"] Jun 05 21:37:06.409292 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.409273 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.413338 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.413306 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 21:37:06.414612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.414592 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lbq4w\"" Jun 05 21:37:06.414612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.414608 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 21:37:06.414612 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.414592 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 05 21:37:06.424729 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.424701 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt"] Jun 05 21:37:06.438992 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.438960 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:37:06.454372 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.454322 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.454551 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.454440 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.454551 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.454470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.454551 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.454537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f959d715-327b-4333-8cc6-c4082fdc0541-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.454693 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.454554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.454693 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.454580 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h7lj\" (UniqueName: \"kubernetes.io/projected/f959d715-327b-4333-8cc6-c4082fdc0541-kube-api-access-5h7lj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.555269 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.555225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.555476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.555383 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.555476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.555414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.555476 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.555465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f959d715-327b-4333-8cc6-c4082fdc0541-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.555638 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.555495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.555638 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.555526 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h7lj\" (UniqueName: \"kubernetes.io/projected/f959d715-327b-4333-8cc6-c4082fdc0541-kube-api-access-5h7lj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.555752 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.555655 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.555864 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.555840 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.555960 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.555859 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.557694 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.557675 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f959d715-327b-4333-8cc6-c4082fdc0541-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.558200 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.558179 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f959d715-327b-4333-8cc6-c4082fdc0541-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.567768 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.567737 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h7lj\" (UniqueName: \"kubernetes.io/projected/f959d715-327b-4333-8cc6-c4082fdc0541-kube-api-access-5h7lj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt\" (UID: \"f959d715-327b-4333-8cc6-c4082fdc0541\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.720047 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.719952 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:37:06.887074 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:37:06.887041 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf959d715_327b_4333_8cc6_c4082fdc0541.slice/crio-f063493d84815dd19a07339412461570bba9a1fcb8c453fc047f9c17d103d8df WatchSource:0}: Error finding container f063493d84815dd19a07339412461570bba9a1fcb8c453fc047f9c17d103d8df: Status 404 returned error can't find the container with id f063493d84815dd19a07339412461570bba9a1fcb8c453fc047f9c17d103d8df Jun 05 21:37:06.887223 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.887076 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt"] Jun 05 21:37:06.973664 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:06.973582 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" event={"ID":"f959d715-327b-4333-8cc6-c4082fdc0541","Type":"ContainerStarted","Data":"f063493d84815dd19a07339412461570bba9a1fcb8c453fc047f9c17d103d8df"} Jun 05 21:37:11.001723 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:11.001686 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" event={"ID":"f959d715-327b-4333-8cc6-c4082fdc0541","Type":"ContainerStarted","Data":"26b63aeace6279181fe34f10e9c22553ac0df501d89c9c85ad593282dc18bc8f"} Jun 05 21:37:12.191780 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:12.191731 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:37:17.011603 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:17.011553 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:37:23.181128 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.181084 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg"] Jun 05 21:37:23.184951 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.184931 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.188930 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.188907 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 21:37:23.198168 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.198139 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg"] Jun 05 21:37:23.230699 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.230666 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:37:23.309202 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.309165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.309202 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.309204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e919f582-54e8-4a2e-beb9-aad5261bffc0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.309477 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.309227 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.309477 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.309287 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.309477 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.309414 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j9j2\" (UniqueName: \"kubernetes.io/projected/e919f582-54e8-4a2e-beb9-aad5261bffc0-kube-api-access-8j9j2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.309477 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.309441 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.410468 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.410425 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e919f582-54e8-4a2e-beb9-aad5261bffc0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.410658 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.410480 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.410658 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.410509 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.410658 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.410565 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j9j2\" (UniqueName: \"kubernetes.io/projected/e919f582-54e8-4a2e-beb9-aad5261bffc0-kube-api-access-8j9j2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.410658 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.410598 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.410837 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.410740 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.411070 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.411042 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.411204 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.411093 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.411204 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.411043 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.412899 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.412879 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e919f582-54e8-4a2e-beb9-aad5261bffc0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.413149 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.413130 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e919f582-54e8-4a2e-beb9-aad5261bffc0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.419591 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.419568 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j9j2\" (UniqueName: \"kubernetes.io/projected/e919f582-54e8-4a2e-beb9-aad5261bffc0-kube-api-access-8j9j2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg\" (UID: \"e919f582-54e8-4a2e-beb9-aad5261bffc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.495850 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.495817 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:23.646960 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:23.646926 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg"] Jun 05 21:37:23.648414 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:37:23.648387 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode919f582_54e8_4a2e_beb9_aad5261bffc0.slice/crio-a6fcdb4bbfcc80e34541fe156d985dbe92a716dd442f83a2e08b1c1fca89af3c WatchSource:0}: Error finding container a6fcdb4bbfcc80e34541fe156d985dbe92a716dd442f83a2e08b1c1fca89af3c: Status 404 returned error can't find the container with id a6fcdb4bbfcc80e34541fe156d985dbe92a716dd442f83a2e08b1c1fca89af3c Jun 05 21:37:24.092627 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:24.092589 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" event={"ID":"e919f582-54e8-4a2e-beb9-aad5261bffc0","Type":"ContainerStarted","Data":"d7363f230ff90e67ff93e98285c1445e451bd9421c4edcbd238de128cb9c68a3"} Jun 05 21:37:24.092808 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:24.092656 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" event={"ID":"e919f582-54e8-4a2e-beb9-aad5261bffc0","Type":"ContainerStarted","Data":"a6fcdb4bbfcc80e34541fe156d985dbe92a716dd442f83a2e08b1c1fca89af3c"} Jun 05 21:37:25.099932 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:25.099896 2567 generic.go:356] "Generic (PLEG): container finished" podID="e919f582-54e8-4a2e-beb9-aad5261bffc0" containerID="d7363f230ff90e67ff93e98285c1445e451bd9421c4edcbd238de128cb9c68a3" exitCode=0 Jun 05 21:37:25.100369 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:25.099992 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" event={"ID":"e919f582-54e8-4a2e-beb9-aad5261bffc0","Type":"ContainerDied","Data":"d7363f230ff90e67ff93e98285c1445e451bd9421c4edcbd238de128cb9c68a3"} Jun 05 21:37:27.117428 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:27.117394 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" event={"ID":"e919f582-54e8-4a2e-beb9-aad5261bffc0","Type":"ContainerStarted","Data":"adf638d925413ac7efb8ef76706c6ef3fe25a7d43818de20bab360070e2d47ec"} Jun 05 21:37:27.140142 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:27.140088 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" podStartSLOduration=1.6777876790000001 podStartE2EDuration="4.140070347s" totalImagesPullingTime="1.173268859s" totalInitContainerRuntime="1.289013809s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:37:27.138039514 +0000 UTC m=+1132.206449424" watchObservedRunningTime="2026-06-05 21:37:27.140070347 +0000 UTC m=+1132.208480246" Jun 05 21:37:33.496413 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:33.496370 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:33.496817 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:33.496452 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:33.509346 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:33.509301 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:34.172637 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:34.172607 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg" Jun 05 21:37:36.518793 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:36.518760 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:37:49.721113 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:37:49.721023 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:02.352504 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:02.352466 2567 generic.go:356] "Generic (PLEG): container finished" podID="f959d715-327b-4333-8cc6-c4082fdc0541" containerID="26b63aeace6279181fe34f10e9c22553ac0df501d89c9c85ad593282dc18bc8f" exitCode=0 Jun 05 21:38:02.352894 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:02.352540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" event={"ID":"f959d715-327b-4333-8cc6-c4082fdc0541","Type":"ContainerDied","Data":"26b63aeace6279181fe34f10e9c22553ac0df501d89c9c85ad593282dc18bc8f"} Jun 05 21:38:03.361813 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:03.361774 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" event={"ID":"f959d715-327b-4333-8cc6-c4082fdc0541","Type":"ContainerStarted","Data":"7cd564a0d8c359dbe0d4df756d41582ccdc476b83913b56280f480520988be2c"} Jun 05 21:38:03.383051 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:03.382995 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" podStartSLOduration=2.237227059 podStartE2EDuration="57.382977605s" totalImagesPullingTime="3.746819622s" totalInitContainerRuntime="51.398930924s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:37:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:38:03.380290348 +0000 UTC m=+1168.448700250" watchObservedRunningTime="2026-06-05 21:38:03.382977605 +0000 UTC m=+1168.451387504" Jun 05 21:38:06.720755 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:06.720718 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:38:06.721220 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:06.720777 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:38:06.733847 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:06.733817 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:38:07.397973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:07.397943 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt" Jun 05 21:38:37.962575 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:37.962534 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:38.910130 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:38.910095 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:39.013973 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:39.013931 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:39.110302 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:39.110268 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:54.877716 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:54.877685 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f857d6fdf-mlrf7_3f31ee75-d56a-4c0e-a46a-bee5574d0c70/nginx/0.log" Jun 05 21:38:55.102674 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:55.102641 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mwrbj_4d866d55-b901-4f85-b320-5e073b8b65d2/manager/0.log" Jun 05 21:38:55.218818 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:55.218731 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7vlpd_056ddee3-3a33-44b6-b168-07a31437cbe1/manager/0.log" Jun 05 21:38:55.328697 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:55.328668 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d86955579-tx2xf_a51a4a8e-8fe9-46bd-a882-e5e9018e8a07/manager/0.log" Jun 05 21:38:55.436536 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:55.436511 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-h5v5r_07bdc101-34f9-43b0-824a-7d5a5e883550/server/0.log" Jun 05 21:38:55.551032 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:55.551001 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-p4whr_6bc3e292-68a6-4178-a98f-1d27915b2251/manager/0.log" Jun 05 21:38:55.783704 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:55.783666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5df7699bf6-ph6b8_5e758c28-18c4-43d0-a05a-ff8a61eedc91/copy-manifests/0.log" Jun 05 21:38:55.789660 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:55.789636 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5df7699bf6-ph6b8_5e758c28-18c4-43d0-a05a-ff8a61eedc91/manager/0.log" Jun 05 21:38:56.613882 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.613851 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5_d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b/extract/0.log" Jun 05 21:38:56.618627 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.618602 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5_d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b/util/0.log" Jun 05 21:38:56.623802 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.623782 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5_d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b/pull/0.log" Jun 05 21:38:56.730658 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.730623 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll_8c5d2690-f2b3-4905-bae7-03e412bd39a1/pull/0.log" Jun 05 21:38:56.736090 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.736064 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll_8c5d2690-f2b3-4905-bae7-03e412bd39a1/extract/0.log" Jun 05 21:38:56.741079 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.741050 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll_8c5d2690-f2b3-4905-bae7-03e412bd39a1/util/0.log" Jun 05 21:38:56.845453 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.845426 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2_8e78d5a6-35af-4674-9ee5-3ab40d051a4b/util/0.log" Jun 05 21:38:56.851296 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.851265 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2_8e78d5a6-35af-4674-9ee5-3ab40d051a4b/pull/0.log" Jun 05 21:38:56.856852 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.856834 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2_8e78d5a6-35af-4674-9ee5-3ab40d051a4b/extract/0.log" Jun 05 21:38:56.962534 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.962459 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l_661b9e7b-3d5f-4576-81e7-02bdfe23045e/util/0.log" Jun 05 21:38:56.969603 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.969579 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l_661b9e7b-3d5f-4576-81e7-02bdfe23045e/pull/0.log" Jun 05 21:38:56.974869 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:56.974850 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l_661b9e7b-3d5f-4576-81e7-02bdfe23045e/extract/0.log" Jun 05 21:38:57.634499 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:57.634470 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6fnh4_1ee09312-76b4-43bd-9884-2c90cd8cd366/manager/0.log" Jun 05 21:38:57.846303 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:57.846274 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5n26w_01911232-d4b0-4d8c-83f0-66655a37c4b4/manager/0.log" Jun 05 21:38:58.288233 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:58.288205 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-52b5r_d3078487-f485-4c49-bfe0-1b2915c4445d/discovery/0.log" Jun 05 21:38:58.395796 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:58.395769 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd79689b-q7tmc_bab694ca-2dc0-4552-8389-88b5ce6bfdb5/kube-auth-proxy/0.log" Jun 05 21:38:58.932727 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:58.932698 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6478957989-b8l59_1461e6c9-bae6-4d82-8c47-381a5c59537e/router/0.log" Jun 05 21:38:59.271886 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:59.271856 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt_f959d715-327b-4333-8cc6-c4082fdc0541/storage-initializer/0.log" Jun 05 21:38:59.278255 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:59.278232 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-sq9mt_f959d715-327b-4333-8cc6-c4082fdc0541/main/0.log" Jun 05 21:38:59.614842 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:59.614727 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg_e919f582-54e8-4a2e-beb9-aad5261bffc0/storage-initializer/0.log" Jun 05 21:38:59.621117 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:38:59.621093 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477chgpmg_e919f582-54e8-4a2e-beb9-aad5261bffc0/main/0.log" Jun 05 21:39:03.135246 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:03.135212 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:03.333008 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:03.332971 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:03.428059 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:03.427977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:06.205226 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:06.205195 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-78t2z_e78fba84-c3e9-4148-992b-5db59929d675/global-pull-secret-syncer/0.log" Jun 05 21:39:06.333091 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:06.333057 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fxwsz_3e7afb40-b6cd-4736-bfe7-abc5e2628b7e/konnectivity-agent/0.log" Jun 05 21:39:06.489163 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:06.489078 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-234.ec2.internal_a5e07cf7bd7f6864d075ef4f05d8ee12/haproxy/0.log" Jun 05 21:39:09.927098 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:09.927054 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-cbttx_b8e13098-0626-4a41-ad73-3c26559d300a/sail-operator/0.log" Jun 05 21:39:11.304143 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.304102 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5_d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b/extract/0.log" Jun 05 21:39:11.327888 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.327856 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5_d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b/util/0.log" Jun 05 21:39:11.348211 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.348172 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cvzg5_d837b1dc-c2ad-4780-ab2d-ba00c9a3bf7b/pull/0.log" Jun 05 21:39:11.375414 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.375392 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll_8c5d2690-f2b3-4905-bae7-03e412bd39a1/extract/0.log" Jun 05 21:39:11.403943 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.403912 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll_8c5d2690-f2b3-4905-bae7-03e412bd39a1/util/0.log" Jun 05 21:39:11.431140 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.431115 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0p5dll_8c5d2690-f2b3-4905-bae7-03e412bd39a1/pull/0.log" Jun 05 21:39:11.465592 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.465541 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2_8e78d5a6-35af-4674-9ee5-3ab40d051a4b/extract/0.log" Jun 05 21:39:11.493261 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.493227 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2_8e78d5a6-35af-4674-9ee5-3ab40d051a4b/util/0.log" Jun 05 21:39:11.514324 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.514297 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kjpp2_8e78d5a6-35af-4674-9ee5-3ab40d051a4b/pull/0.log" Jun 05 21:39:11.541561 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.541533 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l_661b9e7b-3d5f-4576-81e7-02bdfe23045e/extract/0.log" Jun 05 21:39:11.562019 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.561930 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l_661b9e7b-3d5f-4576-81e7-02bdfe23045e/util/0.log" Jun 05 21:39:11.583966 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.583936 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wxm4l_661b9e7b-3d5f-4576-81e7-02bdfe23045e/pull/0.log" Jun 05 21:39:11.798695 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.798660 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6fnh4_1ee09312-76b4-43bd-9884-2c90cd8cd366/manager/0.log" Jun 05 21:39:11.862225 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:11.862144 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5n26w_01911232-d4b0-4d8c-83f0-66655a37c4b4/manager/0.log" Jun 05 21:39:13.556499 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.556471 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d66fceb2-d040-4036-80dc-ac21c69f2f63/alertmanager/0.log" Jun 05 21:39:13.577272 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.577242 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d66fceb2-d040-4036-80dc-ac21c69f2f63/config-reloader/0.log" Jun 05 21:39:13.600442 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.600404 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d66fceb2-d040-4036-80dc-ac21c69f2f63/kube-rbac-proxy-web/0.log" Jun 05 21:39:13.620182 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.620155 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d66fceb2-d040-4036-80dc-ac21c69f2f63/kube-rbac-proxy/0.log" Jun 05 21:39:13.644020 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.643990 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d66fceb2-d040-4036-80dc-ac21c69f2f63/kube-rbac-proxy-metric/0.log" Jun 05 21:39:13.671135 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.671056 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d66fceb2-d040-4036-80dc-ac21c69f2f63/prom-label-proxy/0.log" Jun 05 21:39:13.692262 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.692223 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d66fceb2-d040-4036-80dc-ac21c69f2f63/init-config-reloader/0.log" Jun 05 21:39:13.756992 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.756962 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-jjzv2_8b9b7012-5b30-47b7-8580-f0bd30d6b5d3/kube-state-metrics/0.log" Jun 05 21:39:13.775967 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.775938 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-jjzv2_8b9b7012-5b30-47b7-8580-f0bd30d6b5d3/kube-rbac-proxy-main/0.log" Jun 05 21:39:13.800324 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:13.800298 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-jjzv2_8b9b7012-5b30-47b7-8580-f0bd30d6b5d3/kube-rbac-proxy-self/0.log" Jun 05 21:39:14.039894 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.039858 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4gs5_fb79e112-08ca-4c27-82e2-f50031120210/node-exporter/0.log" Jun 05 21:39:14.062908 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.062883 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4gs5_fb79e112-08ca-4c27-82e2-f50031120210/kube-rbac-proxy/0.log" Jun 05 21:39:14.084178 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.084152 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s4gs5_fb79e112-08ca-4c27-82e2-f50031120210/init-textfile/0.log" Jun 05 21:39:14.119117 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.119094 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8qd2d_b2738009-456e-424b-a0ec-c789639b0bb9/kube-rbac-proxy-main/0.log" Jun 05 21:39:14.142297 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.142270 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8qd2d_b2738009-456e-424b-a0ec-c789639b0bb9/kube-rbac-proxy-self/0.log" Jun 05 21:39:14.163003 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.162981 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8qd2d_b2738009-456e-424b-a0ec-c789639b0bb9/openshift-state-metrics/0.log" Jun 05 21:39:14.399075 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.398999 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-nbvvj_329060e6-4142-4ad6-b905-a05f9b8455f9/prometheus-operator/0.log" Jun 05 21:39:14.422343 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.422299 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-nbvvj_329060e6-4142-4ad6-b905-a05f9b8455f9/kube-rbac-proxy/0.log" Jun 05 21:39:14.447706 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.447663 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-s8bvd_320074eb-8421-4f9e-bdd9-c816af12d956/prometheus-operator-admission-webhook/0.log" Jun 05 21:39:14.479807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.479783 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-757f54cd6d-qlvk5_1f929182-fec7-4a14-9a3d-997d3c5ea860/telemeter-client/0.log" Jun 05 21:39:14.503231 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.503204 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-757f54cd6d-qlvk5_1f929182-fec7-4a14-9a3d-997d3c5ea860/reload/0.log" Jun 05 21:39:14.526273 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:14.526245 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-757f54cd6d-qlvk5_1f929182-fec7-4a14-9a3d-997d3c5ea860/kube-rbac-proxy/0.log" Jun 05 21:39:15.950414 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:15.950385 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-5gnm7_982f450a-3056-4773-b6f4-a5f026cde0fb/networking-console-plugin/0.log" Jun 05 21:39:16.787401 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.787361 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f"] Jun 05 21:39:16.791501 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.791478 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:16.794147 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.794127 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czp5f\"/\"kube-root-ca.crt\"" Jun 05 21:39:16.795138 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.795120 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-czp5f\"/\"default-dockercfg-6cfvz\"" Jun 05 21:39:16.795255 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.795120 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czp5f\"/\"openshift-service-ca.crt\"" Jun 05 21:39:16.802296 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.802267 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f"] Jun 05 21:39:16.923399 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.923309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnc29\" (UniqueName: \"kubernetes.io/projected/92fba17f-f694-445b-a01a-12c3186139de-kube-api-access-rnc29\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:16.923596 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.923447 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-sys\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:16.923596 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.923481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-lib-modules\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:16.923596 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.923553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-podres\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:16.923734 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:16.923602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-proc\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.024295 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.024253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-sys\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.024295 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.024302 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-lib-modules\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.024801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.024380 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-podres\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.024801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.024419 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-sys\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.024801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.024424 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-proc\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.024801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.024471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-proc\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.024801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.024490 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnc29\" (UniqueName: \"kubernetes.io/projected/92fba17f-f694-445b-a01a-12c3186139de-kube-api-access-rnc29\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.024801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.024501 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-lib-modules\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.024801 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.024574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92fba17f-f694-445b-a01a-12c3186139de-podres\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.032765 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.032738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnc29\" (UniqueName: \"kubernetes.io/projected/92fba17f-f694-445b-a01a-12c3186139de-kube-api-access-rnc29\") pod \"perf-node-gather-daemonset-q7f7f\" (UID: \"92fba17f-f694-445b-a01a-12c3186139de\") " pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.102593 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.102495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.121182 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.121157 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56db8c9576-msb92_10f2394d-8159-459c-8c31-8f403afcac5d/console/0.log" Jun 05 21:39:17.244271 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.244239 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f"] Jun 05 21:39:17.245400 ip-10-0-136-234 kubenswrapper[2567]: W0605 21:39:17.245376 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92fba17f_f694_445b_a01a_12c3186139de.slice/crio-ff9c476db48e2e6de6b66c4df96b76d6b6c50928d8d37b095c428e72d3e42d19 WatchSource:0}: Error finding container ff9c476db48e2e6de6b66c4df96b76d6b6c50928d8d37b095c428e72d3e42d19: Status 404 returned error can't find the container with id ff9c476db48e2e6de6b66c4df96b76d6b6c50928d8d37b095c428e72d3e42d19 Jun 05 21:39:17.855716 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.855681 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" event={"ID":"92fba17f-f694-445b-a01a-12c3186139de","Type":"ContainerStarted","Data":"1da83ae8d13619d84da244f8977dd95057488358c8a4397c35e48238a06567b7"} Jun 05 21:39:17.855899 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.855743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" event={"ID":"92fba17f-f694-445b-a01a-12c3186139de","Type":"ContainerStarted","Data":"ff9c476db48e2e6de6b66c4df96b76d6b6c50928d8d37b095c428e72d3e42d19"} Jun 05 21:39:17.855899 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.855819 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:17.866981 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.866946 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-d6s9p_31a3db22-0f4e-4bcb-8401-489e216e1e43/volume-data-source-validator/0.log" Jun 05 21:39:17.876912 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:17.876862 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" podStartSLOduration=1.876847246 podStartE2EDuration="1.876847246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:39:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:39:17.876058853 +0000 UTC m=+1242.944468753" watchObservedRunningTime="2026-06-05 21:39:17.876847246 +0000 UTC m=+1242.945257147" Jun 05 21:39:19.091980 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:19.091954 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvw5m_ebede3cb-2f3e-4d4b-83ae-909de1f9e78b/dns/0.log" Jun 05 21:39:19.117413 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:19.117377 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvw5m_ebede3cb-2f3e-4d4b-83ae-909de1f9e78b/kube-rbac-proxy/0.log" Jun 05 21:39:19.257432 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:19.257398 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hlhxh_9b33faf7-cd54-4f7d-b8a7-dd0c6817fe1c/dns-node-resolver/0.log" Jun 05 21:39:19.885087 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:19.885049 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-crm5k_5e0ece63-babe-4f8b-a960-33ea46fe7da7/node-ca/0.log" Jun 05 21:39:20.919715 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:20.919681 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-52b5r_d3078487-f485-4c49-bfe0-1b2915c4445d/discovery/0.log" Jun 05 21:39:20.939159 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:20.939134 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd79689b-q7tmc_bab694ca-2dc0-4552-8389-88b5ce6bfdb5/kube-auth-proxy/0.log" Jun 05 21:39:21.102633 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:21.102599 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6478957989-b8l59_1461e6c9-bae6-4d82-8c47-381a5c59537e/router/0.log" Jun 05 21:39:21.744076 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:21.744046 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c85sh_54379baf-13d5-418c-acea-be62ec48b079/serve-healthcheck-canary/0.log" Jun 05 21:39:22.338156 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:22.338129 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4dwkt_d65a3ec8-23f8-4538-abb4-5c7b904b19fa/insights-operator/0.log" Jun 05 21:39:22.340547 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:22.340524 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-4dwkt_d65a3ec8-23f8-4538-abb4-5c7b904b19fa/insights-operator/1.log" Jun 05 21:39:22.447250 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:22.447226 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6fbdm_14175f50-3032-472f-9b1b-911e7ec10dcd/kube-rbac-proxy/0.log" Jun 05 21:39:22.467744 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:22.467718 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6fbdm_14175f50-3032-472f-9b1b-911e7ec10dcd/exporter/0.log" Jun 05 21:39:22.495086 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:22.495058 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6fbdm_14175f50-3032-472f-9b1b-911e7ec10dcd/extractor/0.log" Jun 05 21:39:23.872792 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:23.872764 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-czp5f/perf-node-gather-daemonset-q7f7f" Jun 05 21:39:24.792901 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:24.792873 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f857d6fdf-mlrf7_3f31ee75-d56a-4c0e-a46a-bee5574d0c70/nginx/0.log" Jun 05 21:39:24.893873 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:24.893841 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-mwrbj_4d866d55-b901-4f85-b320-5e073b8b65d2/manager/0.log" Jun 05 21:39:24.937991 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:24.937956 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-7vlpd_056ddee3-3a33-44b6-b168-07a31437cbe1/manager/0.log" Jun 05 21:39:24.967240 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:24.967167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d86955579-tx2xf_a51a4a8e-8fe9-46bd-a882-e5e9018e8a07/manager/0.log" Jun 05 21:39:24.996056 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:24.996029 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-h5v5r_07bdc101-34f9-43b0-824a-7d5a5e883550/server/0.log" Jun 05 21:39:25.048484 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:25.048366 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-p4whr_6bc3e292-68a6-4178-a98f-1d27915b2251/manager/0.log" Jun 05 21:39:25.158813 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:25.158784 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5df7699bf6-ph6b8_5e758c28-18c4-43d0-a05a-ff8a61eedc91/manager/0.log" Jun 05 21:39:25.180936 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:25.180912 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5df7699bf6-ph6b8_5e758c28-18c4-43d0-a05a-ff8a61eedc91/copy-manifests/0.log" Jun 05 21:39:26.900589 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:26.900562 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hw7s6_9f2391e2-8b1f-4d6c-9907-39af70c16015/openshift-lws-operator/0.log" Jun 05 21:39:31.165819 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:31.165784 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-52b5r_d3078487-f485-4c49-bfe0-1b2915c4445d/discovery/0.log" Jun 05 21:39:31.175263 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:31.175237 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd79689b-q7tmc_bab694ca-2dc0-4552-8389-88b5ce6bfdb5/kube-auth-proxy/0.log" Jun 05 21:39:31.304605 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:31.304574 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6478957989-b8l59_1461e6c9-bae6-4d82-8c47-381a5c59537e/router/0.log" Jun 05 21:39:32.538640 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:32.538607 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-52b5r_d3078487-f485-4c49-bfe0-1b2915c4445d/discovery/0.log" Jun 05 21:39:32.548977 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:32.548956 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd79689b-q7tmc_bab694ca-2dc0-4552-8389-88b5ce6bfdb5/kube-auth-proxy/0.log" Jun 05 21:39:32.633249 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:32.633217 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6478957989-b8l59_1461e6c9-bae6-4d82-8c47-381a5c59537e/router/0.log" Jun 05 21:39:32.870596 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:32.870512 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-g4jrp_998edffc-37fa-4c24-bc4b-38af52c4a3f3/kube-storage-version-migrator-operator/1.log" Jun 05 21:39:32.871324 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:32.871303 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-g4jrp_998edffc-37fa-4c24-bc4b-38af52c4a3f3/kube-storage-version-migrator-operator/0.log" Jun 05 21:39:34.317431 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.317351 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtt5b_d3dee655-6d78-4584-a7b4-dc8b54feeca8/kube-multus-additional-cni-plugins/0.log" Jun 05 21:39:34.340215 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.340182 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtt5b_d3dee655-6d78-4584-a7b4-dc8b54feeca8/egress-router-binary-copy/0.log" Jun 05 21:39:34.356063 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.356035 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-52b5r_d3078487-f485-4c49-bfe0-1b2915c4445d/discovery/0.log" Jun 05 21:39:34.361807 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.361785 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtt5b_d3dee655-6d78-4584-a7b4-dc8b54feeca8/cni-plugins/0.log" Jun 05 21:39:34.364557 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.364537 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd79689b-q7tmc_bab694ca-2dc0-4552-8389-88b5ce6bfdb5/kube-auth-proxy/0.log" Jun 05 21:39:34.387118 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.387092 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtt5b_d3dee655-6d78-4584-a7b4-dc8b54feeca8/bond-cni-plugin/0.log" Jun 05 21:39:34.408665 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.408635 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtt5b_d3dee655-6d78-4584-a7b4-dc8b54feeca8/routeoverride-cni/0.log" Jun 05 21:39:34.432357 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.432312 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtt5b_d3dee655-6d78-4584-a7b4-dc8b54feeca8/whereabouts-cni-bincopy/0.log" Jun 05 21:39:34.439795 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.439766 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6478957989-b8l59_1461e6c9-bae6-4d82-8c47-381a5c59537e/router/0.log" Jun 05 21:39:34.453287 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.453254 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtt5b_d3dee655-6d78-4584-a7b4-dc8b54feeca8/whereabouts-cni/0.log" Jun 05 21:39:34.668554 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.668469 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bv8g6_76714011-f2b4-489e-b19a-5aac794b91a7/kube-multus/0.log" Jun 05 21:39:34.824631 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.824599 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fpmnj_aa53bf6c-8b56-457a-9ccd-ccd794dc48a8/network-metrics-daemon/0.log" Jun 05 21:39:34.845635 ip-10-0-136-234 kubenswrapper[2567]: I0605 21:39:34.845604 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fpmnj_aa53bf6c-8b56-457a-9ccd-ccd794dc48a8/kube-rbac-proxy/0.log"